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Executive SyUnOISFy Communities across the nation are realizing that 

after-school programs help children become respon- 
sible, productive citizens of tomorrow, while helping 
their parents be responsible, productive citizens 
today. As a result, new programs are springing up all 
over the country. With the passage of the No Child 
Left Behind Act in January 2002, the issue of after- 
school programming will be on the minds and the 
agendas of more people than ever before. 

This act converted the 21st Century Community 
Learning Centers (21st CCLC) from a federally to a 
state administered program. Every state is eligible to 
receive a portion of the billion dollars appropriated 
for the program, giving all the states a concrete fund- 
ing opportunity to address the after-school needs of 
school-aged children. With this opportunity will 
come the need to make many decisions about the 
goals, design and content of the after-school pro- 
gramming, decisions that will influence which chil- 
dren and youth participate, what they experience 
and how they may benefit. This report aims to put 
policymakers and program operators on firmer 
ground as they make these decisions by sharing les- 
sons learned about the design and content of exist- 
ing school-based, after-school programs. 

In 1997, amidst the growing interest in after-school 
programs, the Wallace-Reader’s Digest Funds 
launched the Extended-Service Schools (ESS) 
Initiative, which supported the creation of 60 after- 
school programs in 20 communities around the 
country. Each community adapted one of four 
nationally recognized models that had been success- 
fully developed and implemented in other cities 
around the country. These models — the Beacon, 
Bridges to Success, Community Schools and the West 
Philadelphia Improvement Corporation — all seek to 
promote academic and non-academic development 
of young people during their out-of-school hours, 
but differ in organizational structure and manage- 
ment and, to a lesser extent, in programmatic 
emphasis. At the same time, the models share several 
key features. They all operate their programs in 
school buildings; involve partnerships between com- 
munity-based organizations (and/or universities) and 
schools; and offer a range of activities to the children 
and youth who participate, including academic and 
enrichment activities, and sports and recreation. In 
addition, in all four models, the financial resources 
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are under the control of the partnering organization 
rather than the school. 

As a result of this “sameness” within variation, ESS 
provided an almost unique opportunity to identify 
and examine overarching issues involved in providing 
opportunities to youth in their after-school time — 
issues that transcend local context and the formal ele- 
ments of specific models. In particular, the ESS 
initiative allowed a focus on four central questions: 

• Which children and youth came to the after- 
school programs? Why did they come? Were the 
programs attracting the young people who 
could most benefit from participation? 

• What were the characteristics of high-quality 
activities in these programs — activities that pro- 
moted the positive development of the children 
and youth who attended? 

• WTiat benefits did the children and youth gain 
from participation? 

• What was the cost to operate the after-school 
programs, and what were the ways to finance 
them? 

Starting in May 1998, Public/Private Ventures 
(P/PV) and the Manpower Demonstration Research 
Corporation (MDRC) began the evaluation of this 
large-scale initiative. We used a multi-method 
approach designed to provide both an understand- 
ing of the breadth of programming experiences and 
the ability to more deeply delve into particular issues. 
To learn about the activities of all the ESS programs, 
we asked all the school site coordinators and city- 
level program directors to complete annual organiza- 
tional surveys summarizing what their programs were 
doing. To gain deeper insight into individual sites 
and learn about promising practices, we conducted 
multiple in-depth site visits to 10 cities during 1999- 
2000, interviewing staff, partners, students, parents 
and key city officials. 

We also intensively focused on programs in a total of 
10 schools in six of these cities. During 2000-2001, we 
‘collected computerized attendance records from 
those programs and gathered cost data. We adminis- 
tered a baseline questionnaire to fourth- to eighth- 
grade students between Fall 1999 and the end of 
2000 as they enrolled in the program or the 
research. In Spring 2001, we administered a follow- 
up survey to fourth- to eighth-grade students who 



Multiple Choices After School: Findings from the Extended -Service Schools Initiative 



had ever enrolled in ESS and were still in the school 
(although not necessarily currently participating in 
ESS). A telephone survey of a sample of those stu- 
dents’ parents was also conducted to learn about the 
program from their perspective. And, finally, in 3 of 
the 10 schools, we conducted multiple observations 
of the after-school activities. 

What Have We Learned? 

We found that, across all of the sites, the school- 
based, after-school programs could be put in place 
fairly quickly. It typically took from six to nine 
months for programs to find organizational partners 
and staff, assess community needs, pool additional 
community and financial resources, identify activity 
providers and recruit participants. The initial plan- 
ning time was critical and, importantly, the ESS pro- 
grams each received a grant of $25,000 to $50,000, as 
well as technical assistance, to help support this 
process. Over the next three years, the programs 
matured and demand for their services grew. 
Programs became better able to identify and address 
core goals, honed their recruiting strategies and, for 
the most part, developed strong relationships with 
their host schools. They also began to more directly 
focus on addressing program quality, rather than just 
program provision. Still, they continued to face oper- 
ational challenges. These included funding con- 
straints, staff shortages and retention, and difficulty 
in creating and implementing approaches for moni- 
toring and assessing program quality. 1 

The remaining pages of this executive summary 
focus on key findings from the 10 intensive-study, 
after-school programs. 

Who Participated? 

1. Demand for the programs was substantial. 
Parents enrolled their children in large num- 
bers. Among the 10 programs we intensively 
studied, eight considered themselves to be oper- 
ating at capacity — serving as many students as 
they could within their available resources — by 
their second year of operations. In fact, interest 
in the after-school programs was so high, rela- 
tive to available resources, that three of those 
programs capped their enrollments; and one 
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program, in its effort to meet the demand for 
registration, limited the number of days a week 
for which each youth could register. Across the 
eight sites that collected participation data on 
all youth who were enrolled in ESS, slightly 
more than half of the schools’ total populations 
were attending the after-school programs. 

2. On average, students participated in ESS for 20 
days in a typical semester. They also tended to 
participate over an extended period of time, 
not just a single semester. 

Students who enrolled in ESS attended slightly 
under two days each week, on average. While 
this participation rate could suggest that stu- 
dents might not be attending often enough for 
programs to achieve their goals of strengthen- 
ing youth’s academic and social skills, it is 
important to understand that many of the par- 
ticipants attended these programs over an 
extended period of time. More than a third 
(35%) of die enrollees participated all four 
semesters that were covered by this study and, 
overall, 84 percent participated in two or more 
semesters. These participation patterns suggest 
the possibility of a cumulative effect of less 
intensive participation over time. In addition, 
for many youth, ESS was only one aspect of 
their participation in organized after-school 
activities, and those other activities also have the 
potential of providing supports and opportuni- 
ties for positive development. 

3. Higher-needs students and older youth were 
more difficult to attract to the after-school 
programs. 

In ESS, as has also been found in other after- 
school programs, younger children attended 
more frequently than older youth. In addition, 
the students who were most easily recruited for 
the program tended to be those who were 
already “joiners.” As the programs developed, 
staff began to more specifically target some of 
their recruitment strategies toward attracting 
the most high-needs youth — the “non-joiners” — 
students who were failing courses, were disen- 
gaged from school and had behavior problems. 
However, the challenges of attracting and 
retaining older and higher-needs students 
remained an ongoing issue for the programs. 



4. Programs that required registration for a 
greater number of days per week were able to 
more intensively serve participants, but those 
programs served fewer students overall. 

Required four- or five-day-a-week enrollment 
increased both the number of scheduled days 
and days attended, but allowing youth to regis- 
ter for only a few days a week meant that pro- 
grams could serve greater numbers and, 
perhaps also, more diverse groups of youth. The 
ESS programs also found that required five-day- 
a-week enrollment resulted in low attendance 
rates unless they had a well-articulated and 
enforced attendance policy. 

What Was the Quality of the After-School 
Activities? 

1 . The ESS activities were, on the whole, well 
designed and well implemented; and different 
kinds of activities provided opportunities for 
youth to develop in different areas. 

Among the 30 activities that we observed, all 
but two provided at least some developmental 
supports and opportunities for youth, although 
the types of supports varied. Academic activities 
like homework help and tutoring are a “given” 
in school-based, after-school programs, and 
when done well, they provide youth with strong 
adult support that is valuable even beyond the 
activities’ immediate purpose of building aca- 
demic skills. Among the ESS programs, how- 
ever, the enrichment activities provided youth 
with the richest environment for positive devel- 
opment. In addition to fostering strong adult- 
youth relationships, they provided opportunities 
for cooperative peer interaction and collabora- 
tive learning, and for youth to develop decision- 
making and leadership skills. A number of these 
activities also incorporated such academic skills 
as writing, math and problem solving. 

2. It was not the topic or skill that was being 
addressed, but the ability of the staff member 
leading the session that was the key to high- 
quality activities. 

While youth came to the activities with some ini- 
tial interest in them, that interest was most 
likely to be heightened and sustained when spe- 
cific practices were in place. These included the 
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activity leader’s ability to create a positive social 
environment, where both adult-youth and peer 
relationships were warm and friendly, and a sup- 
portive but challenging intellectual environment 
where the adult actively motivated youth, 
pushed them to achieve beyond their (the 
youth’s) initial expectations, encouraged them 
to persevere and praised their accomplishments. 
It did not seem to matter whether the activity 
leader was a youth worker from a community- 
based organization (CBO) or a teacher from the 
school. Teachers could be as warm and respon- 
sive to youth as were experienced staff from 
CBOs, and the latter were just as successful in 
instructing youth as were the teachers. 

What Were the Benefits to Participants? 

1 . Participation in school-based, after-school pro- 
grams was associated with behavior that could 
help youth stay out of trouble. 

One key goal of after-school programs is to pro- 
ride youth with productive ways to use their out- 
of-school time and, thus, reduce their 
opportunities for risk-taking behavior. Our find- 
ings are consistent with ESS haring this effect. 
Youth who attended the after-school programs 
reported less often that they had started drink- 
ing alcohol, and indicated more often than 
youth who did not attend ESS that they handled 
their anger in socially appropriate ways. 

2. Participation in the after-school programs was 
associated with positive effects on school atti- 
tudes and behaviors, but it is too early to know 
whether it has an impact on students* grades 
and test scores. 

A second important goal of after-school pro- 
grams is improved academic outcomes for 
youth. Because most of the ESS programs were 
new and students participated, on average, 
fewer than two days a week and only for a year, 
we did not expect to find changes in grades. 
Thus, we instead examined indicators of aca- 
demic improvement, such as youth’s sense of 
competence in school and their level of effort. 
We found that youth who attended ESS 
reported more often that they really paid atten- 
tion in class and were very proud to belong to 
their school, and they less often reported that 



they had started skipping school during the 
period between the baseline and follow-up 
surveys. 

It is important to note that some of the 
apparent benefits associated with risk-taking 
behavior and school attitudes may reflect the 
fact that better-behaved and more academically 
inclined students participate in school-based, 
after-school programs. However, in the tele- 
phone survey, 80 to 90 percent of parents 
agreed with statements that ESS was helping 
their child make new friends and get along bet- 
ter with their peers, stay out of trouble, like 
school more and try harder in school, learn 
new skills and become more self-confident. 

How Much Did the Programs Cost? 

1 . The costs were reasonable but varied 
considerably. 

The 10 intensive-study ESS programs cost, on 
average, approximately $150,000 per school 
year (excluding the use of the space) to serve 
63 youth each day after school for five days a 
week. This translates into an average cost per 
day per youth slot of about $15 when all activi- 
ties were in session. Among the 10 programs, 
however, this cost ranged from $8 to $36. This 
range resulted from a variety of factors, includ- 
ing requirements of the community setting (for 
example, the need to provide transportation 
home for participants at the end of the day); 
the programs’ administrative structure; the 
kinds of activities offered and the staff-to-youth 
ratio; and investment in such factors as 
fundraising and the future sustainability of the 
program. 

2. Schools and school districts were essential 
sources of support. 

Both school districts and individual schools that 
hosted the programs made important cash and 
redirected (non-cash) contributions. In the 10 
intensive-study ESS sites, these partners con- 
tributed, on average, more than 20 percent of 
the cost of the program, including some or all 
of the cost of transportation, custodial assis- 
tance and snacks for participants. This contribu- 
tion was in addition to the rent-free use of the 
school building. 
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3. About 60 percent of the programs’ budget 

needs were funded by cash grants. Raising these 
funds to sustain the programs over time 
remains challenging for the sites. 

The cash budget is the core of the program — it 
pays the salaried staff who administer the pro- 
gram and leverage the redirected contributions 
from schools, CBOs and other partners. For the 
ESS sites, a large percentage of their cash 
budget came through support from the 
Wallace-Reader’s Digest Funds. Sustaining the 
programs over time, after this initial funding 
ends, is likely to be an ongoing challenge. 
Strong leadership — whether it comes from a 
CBO, the school district or another partnering 
organization — will be a key to success. Thus far, 
several strategies have seemed promising: start- 
ing out the initiative in the Bridges to Success 
model, which has funding from the United 
Way; having strong lead agencies for whom die 
ESS initiative fits a need; and developing strong 
partnerships with other providers and funders. 
Some sites have collaborated with other youth- 
serving initiatives to work toward the ultimate 
goal of dedicated state funding, but this is a 
long-term strategy. More immediately, they are 
likely to have to rely heavily on local resources 
for youth programs, and the availability of those 
resources varies across cities. 

What are the Policy implications of 
these Findings? 

1. Locating the programs in schools serving low- 
income families was an effective means of tar- 
geting low-income children. However, special 
efforts are required if programs are going to be 
able to attract older youth and the most high- 
needs students in those schools. 

In ESS, participants reflected the demographics 
of their schools. Across the sites, the children 
and youth were overwhelmingly low-income, 
with almost three-quarters eligible for free or 
reduced-price lunch. However, while locating 
programs in schools where students have identi- 
fiable needs can go a long way toward effec- 
tively targeting services, the sites found that 
engaging older and higher-needs youth was a 
challenge. It seems likely that after-school 



programs, in general, would benefit from more 
information on attracting and serving these 
populations. 

2. Choices about program requirements and con- 
tent influence which children and youth enroll 
in the after-school activities and how often they 
attend. 

Program characteristics affect participation pat- 
terns. At the ESS sites, planners had to make 
decisions about the goals and design of their 
programs that ultimately had an effect on which 
children and youth chose to participate and 
how often they attended. These decisions 
inevitably involved some trade-offs. For exam- 
ple, planners who decided that the program 
should serve, in part, as child care for parents 
were more likely to require, or at least allow, 
five-day-a-week enrollment. However, programs 
that designed their activities in a more flexible 
manner (for example, art on Mondays, judo on 
Tuesdays, etc.) and permitted registration for 
fewer days per week touched the lives of larger 
numbers of youth and may have attracted youth 
with more diverse interests. In addition, more 
flexible programs are likely to be more attrac- 
tive to older youth and those who want to par- 
ticipate in other activities, such as sports. 

Survey responses of ESS participants and 
their parents suggest that there are no easy 
answers for program planners as they make 
their decisions. Substantial proportions of both 
the youth and parents said the youth did not 
attend ESS more often because they had other 
things to do elsewhere. Some of these youth 
and their parents did not want to commit to 
more intensive participation in a single pro- 
gram. At the same time, however, a significant 
number of parents said that restrictive enroll- 
ment policies limited the amount of time their 
children might otherwise have participated in 
ESS. Clearly, no approach serves the needs of 
every child or parent equally well, but the find- 
ings emphasize that planners could benefit by 
getting input from their communities. 
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3. To provide a range of developmental supports 
and opportunities to children and youth, after- 
school programs should offer a variety of activi- 
ties staffed by skilled leaders. 

Activities of all types — be they academic, enrich- 
ment, community service or sports — can pro- 
vide children and youth with valuable 
developmental supports and opportunities. By 
participating in a range of challenging and 
interesting activities, young people have the 
chance to develop new skills and interests, build 
positive and supportive relationships with adults 
and peers, and develop a sense of mattering 
through making decisions and taking on leader- 
ship roles. Staff practices and behaviors are the 
critical ingredient. Staff in high-quality activities 
set up physically and emotionally safe environ- 
ments in which they heighten and sustain the 
youth’s interest, making the activity challenging, 
as well as promoting learning and self-discovery 
in multiple areas (academic, social, personal). 
And yet, low wages and part-time hours driven 
by too-tight budgets, along with the limited sup- 
ply of qualified youth workers, combine to 
make staff shortages and retention one of the 
largest continuing challenges for after-school 
programs. 

4. Cost depends as much on program choices, 
opportunities and local conditions as on the 
number of children served. 

The cost per youth slot per day ranged from $8 
to $36 across the 10 intensive-study programs, 
suggesting that there is no one “right” cost of 
an after-school program. In fact, the cost of 
individual after-school programs depended on a 
number of factors, including decisions about 
the types of activities provided, the staff-to-youth 
ratio, and the extent of investment in such fac- 
tors as fundraising and the future sustainability 
of the program. Looking across programs at a 
high or low level of expenditures in each of 
these areas, policymakers and practitioners 
should ask, AVhat does the program and the 
community gain from higher expenditures?”; 
and, “What does the program and the commu- 
nity do without by holding expenditures at the 
low end of the range?” 



5. As after-school programs multiply, the challenge 
of raising both cash and non-cash funding is 
likely to increase as more programs compete 
for limited resources. 

The experience of the ESS sites suggests there 
are challenges involved in finding sustainable 
sources of cash funding. While policymakers 
acknowledge the need to subsidize after-school 
programs in poor communities (as evidenced 
by the 21st CCLC funds, some state and local 
funds, and much philanthropic support), the 
current system still requires programs to live 
year to year scrambling for funds. There are few 
long-term and stable financial resources for 
after-school programs. 

While much of the focus on planning and 
sustaining programs tends to be on raising cash 
funding, the non-cash portion of the budget 
cannot be taken for granted. Across the 10 
intensive-study programs, 40 percent of the 
budget, on average, was obtained through con- 
tributions from partner organizations. However, 
as after-school programs grow to scale, this form 
of support is likely to become more tenuous. 

For example, while school district contributions 
to the after-school programs grew over the 
course of the initiative, districts in several of the 
ESS cities felt the pressure of providing “free” 
services without additional income. A similar 
dilemma exists for CBOs. Currently, many 
CBOs share their resources with fledgling after- 
school programs. However, CBOs’ resources are 
limited. While the marginal cost of contributing 
to one after-school program may be small, con- 
tributing to many after-school programs in a city 
would require expanded resources for CBOs. 

6. Policymakers need to shift their thinking from 
creating the program to expanding the set of 
options available in a community. 

As children become older, they begin to search 
for a wider range of experiences. This expan- 
sion in their worlds is developmentally appro- 
priate, but it means that the participation rates 
of older youth in any particular program — be it 
ESS or something else — will likely be relatively 
low. They are most likely to benefit if they, and 
their parents, are able to put together a mosaic 
of positive experiences — broadening the range 
of activities, widening their geographic hori- 
zons, and increasing their network of adults and 
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peers. If there are several opportunities in their 
community that attract them, they can still be 
well served even though no one program seems 
to be engaging them intensively. As a recendy 
released National Academy of Science report 
emphasizes, “The diversity of young people, 
their particular needs and their surrounding 
environments argue against the notion that a 
single [type of] program will fit all situations .” 2 

Given the increasing challenges to children’s lives 
and the increasingly more complex sets of skills and 
abilities that are required for success in the work- 
place of the twenty-first century, we need to revisit 
how and where we make investments in our nation’s 
children. This report has examined one type of 
investment — school-based, after-school programs run 
by CBOs in collaboration with schools. We found 
that these programs, which are not strictly academic, 
appear to help participants work on many of the 
competencies they will need for their future. When 
well planned and implemented, such programs can 
be a substantial option within a potentially larger net- 
work of diverse programming that provides a range 
of opportunities for all children and youth. 



Endnotes 

1. The ESS sites’ planning and early implementation experiences are 
examined in Extended-Sej-vice Schools: Putting Programming in Place. 
Karen E. Walker, Jean Grossman and Rebecca Raley. Philadelphia: 
Public/Private Ventures, December 2000. 

2. Jacquelynne Eccles and Jennifer A. Gootman. Community Programs 
to Promote Youth Development. Washington , D.C.: National Academy 
Press, 2001. 
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| H Introduction Since the mid-1990s, there has been rapidly increas- 

ing public attention to after-school programming. 
The most visible federal effort, the 21st Century 
Community Learning Centers (21st CCLC), has 
grown from $40 million in 1998 to the billion dollars 
signed into law in January 2002. State legislatures 
have also been quite active. During the past few 
years, legislatures collectively created 215 statutes 
that support out-of-school-time initiatives, and almost 
two-thirds of states directed state funds to local 
school districts to support after-school programs. 1 As 
of this year, all states will become involved with after- 
school programs because the 21st CCLC funds will 
now be awarded and administered by state education 
agencies. 

Why has there been this explosion of public interest 
in after-school programming? First, the composition 
of the workforce has changed over the last genera- 
tion. There are now more than 50 million working 
parents. When their children were preschool ages, 
they created strong political pressure for the govern- 
ment to provide child care and preschool funding. 
Now their children are in school — and in record 
numbers. In 1999, the number of children enrolled 
in school returned to its all-time high of 49 million 
(set in 1970), and enrollment growth is expected to 
continue. 2 

Thus, it is not surprising that 8 in 10 voters believe 
that organized after-school programs are a necessity 
in their communities, and two-thirds of voters say 
they are willing to pay $100 more per year in state 
taxes to help fund the programs. These parents 
emphasize that they want their children to be in a 
safe environment and involved in constructive activi- 
ties with adult supervision. 3 Policymakers share those 
concerns. Research suggests that when young people 
are on their own without an adult presence during 
die after-school hours, they are less safe, more vul- 
nerable to becoming victims or perpetrators of 
crime, and more likely to become engaged in such 
high-risk activities as experimenting with alcohol, 
drugs and sex. 4 

A second powerful force stimulating interest in after- 
school time is the significant pressure that schools, 
public officials and politicians have felt to improve 
student performance. Many school districts have 
been eliminating “social promotion” policies and 
implementing stricter academic standards in their 
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place. The recently passed federal legislation, the 
“No Child Left Behind Act,” reflects this concern. 
Among other things, it mandates annual testing in 
reading and math for students in grades 3 through 8, 
and offers rewards for schools where students suc- 
ceed on those tests and the possibility of sanctions 
for schools where students fail. 

While, traditionally, schools have educated and 1 
socialized children without working closely with oth- 
ers in the community, they are rapidly realizing that 
they alone cannot achieve the desired educational 
goals. The needs of the children that schools serve 
have substantially grown over the last generation. 

The changing nature of the workplace is demanding 
that students develop skills far beyond reading and 
math, including strong communication and problem- 
solving skills and the ability to work well in teams and 
to show leadership. At the same time, more children 
are coming to school with more problems that make 
it difficult for them to learn. Faced with overcrowded 
classrooms, mandates to meet required curricular 
guidelines, and a myriad of learning and behavioral 
needs among their students, teachers have little 
opportunity to give these children the kind of one-to- 
one attention that is necessary if they are going to be 
able to master concepts, develop self-confidence and 
experience success in school. 

For years, parents who could afford it, and who had 
access, used local youth programs — enrichment activ- 
ities, clubs, sports teams and faith-based youth 
groups — to help support their children’s develop- 
ment. Now, parents and the general public are 
increasingly seeing after-school programs not as 
something extra, but as an essential support for 
young people as they grow and develop. School 
buildings would seem a natural location for these 
programs. They are situated in the communities, and 
their facilities — gyms, classrooms, auditoriums, 
libraries and computer labs — are appropriate for a 
wide range of activities. In addition, being located in 
schools would provide programs with ready access to 
potential participants and offer legitimacy to parents 
who might feel hesitant about allowing their children 
to participate in programs elsewhere. 



Multiple Choices After School: Findings from the Extended-Service Schools initiative 



The Extended-Service Schools Dnifiafive 

In 1997, amidst this growing interest in after-school 
programs, the Wallace-Reader’s Digest Funds 
launched the Extended-Service Schools Initiative 
(ESS) , which supported the creation of 60 after- 
school programs in 20 communities around the 
country. Each community adapted one of four 
nationally recognized models that had been success- 
fully developed and implemented in other cities 
around the country. 

The models — Beacon, Bridges to Success, 
Community Schools and West Philadelphia 
Improvement Corporation (WEPIC) — all seek to 
promote the well being and positive development of 
young people in their out-of-school hours, but they 
differ in organizational structure and management 
and, to a lesser extent, programmatic emphasis. At 
the same time, these models share three common 
features. They all: 

• Operate their programs in school buildings. 

• Involve partnerships between community-based 
organizations (and/or universities) and schools. 
The financial resources are under the control 
of the partnering organization rather than the 
school. 

• Offer a range of activities to the children and 
youth who participate, including academic and 
enrichment activities, and sports and recre- 
ation. 

(See Appendix A for a description of each model.) 

While they vary in structural and even philosophical 
ways, the models, thus, share essential common ele- 
ments. The ESS programs built from these models 
incorporate these commonalities and differences and, 
in addition, vary widely in size and location. As a result 
of diis “sameness” within variation, ESS provides an 
almost unique opportunity to identify and examine 
overarching issues involved in providing opportunities 
to youth in their after-school time — issues that tran- 
scend local context and the formal elements of spe- 
cific models. In particular, the ESS initiative allows a 
focus on the following central questions: 

• Which children and youth come to after-school 
programs? Why do they come? Are the 
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programs attracting the young people who 
could most benefit from participation? 

• What are the characteristics of high-quality 
activities in these programs — activities that pro- 
mote die positive development of the children 
and youth who attend? 

• What benefits do the children and youth, and 
their families, gain from participation? 

• What is the cost to operate after-school pro- 
grams and what are the ways to finance them? 

Answers to these questions will be most directly appli- 
cable to after-school programs that share the features 
common to the ESS sites: programs that are school- 
based and led by a community-based organization 
(or university) in partnership with a school, and that 
offer a range of academic and other developmental 
activities to participants. However, much of the dis- 
cussion should also be useful in considering other 
types of after-school programs, whether they are run 
by the schools themselves in their buildings or 
offered by community-based organizations (CBOs) in 
community centers. 

The ESS Evaluation 

Starting in May 1998, Public/Private Ventures 
(P/PV) and the Manpower Demonstration Research 
Corporation (MDRC) began the evaluadon of this 
large-scale initiative to provide practitioners, funders 
and policymakers with a rich set of lessons about how 
local, school-based collaborations unfold and what 
they do. The evaluation used a multi-method 
approach designed to provide both an understand- 
ing of the breadth of programming experiences and 
the ability to delve more deeply into particular issues. 
(See Appendix B for a complete description of the 
research methodology.) 

To learn about die acdvities of all the ESS programs, 
we asked all the school site coordinators and city- 
level program directors to complete annual organiza- 
tional surveys summarizing what their programs were 
doing. To gain deeper insight into individual sites 
and learn about promising pracdces, we conducted 
multiple in-depth site visits to 10 cities during 1999- 
2000, interviewing staff, partners, students, parents 
and key city officials. 



We also focused intensively on a total of 10 programs 
in six of these cities, where we made additional visits 
during 2000-2001. We collected computerized atten- 
dance records from the programs; gathered cost 
data; and administered a baseline questionnaire to 
all fourth- through eighth-grade students between 
Fall 1999 and the end of 2000 as they enrolled in the 
program. 5 In Spring 2001, we administered a follow- 
up survey to fourth- through eighth-grade students 
who had ever enrolled in ESS and were still in the 
school (although not necessarily currendy participat- 
ing in ESS). A telephone survey of a sample of those 
students’ parents was also conducted to learn about 
the program from their perspective. 

Lasdy, in three of those 10 schools, we conducted 
multiple observations of the activities and open- 
ended interviews with 30 child-teacher-and-parent tri- 
ads to collect in-depth information about the quality 
of the activities and the ways the program fit into the 
lives of children (see Figure 1, for the locations of 
the ESS programs and the locations of the six cities 
where we conducted the intensive research.) 

The Organization of this Report 

Two previous reports discussed early findings from 
the evaluation, focusing on the ESS sites’ planning 
and early implementation periods, and their initial 
challenges and accomplishments. 6 This report 
focuses on the experiences “on the ground” of the 
still young but maturing programs. 

The next chapter, Chapter II, draws on information 
from across all of the ESS sites to provide back- 
ground information about the after-school programs. 
The following chapters more sharply focus on the 10 
programs which we examined in greater depth. 
Chapter III describes who participated in the pro- 
grams, how often they came and why. Chapter IV 
looks closely at the activities offered in three of those 
programs in order to describe qualities of partici- 
pants’ after-school experiences that most likely 
appear to contribute to positive youth development. 
Chapter IV also discusses the ways in which, and 
extent to which, those qualities were manifested in 
the after-school activities we observed. 
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;0gure 
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* Indicates cities where the 10 intensive research ESS programs are located. 




Chapter V discusses benefits to the children and 
youth who participated in the after-school activities at 
the 10 intensive research sites. Chapter VI examines 
the costs and funding of those programs, as well as 
strategies the sites are using to develop funding to 
sustain their programs into the future. A final chapter 
offers conclusions and a discussion of lessons learned. 
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It used to be that anyone walking into a school at 2:30 
p.m. would see students and teachers finished for the 
day and preparing for a mass exodus. But now, in 
schools across the country, the afternoon bell marks 
not an end, but the beginning of an extended day. 

At 2:30 p.m., a visitor who steps inside one of the 60 
schools hosting ESS programs — in this particular case, 
a middle school — might see students flooding out into 
the hallways, their noise level marking the end of their 
traditional school day. Some quickly head for home, 
but many others remain. These students make brief 
stops at their lockers and then head for the school 
cafeteria, where they pick up a healthy snack and 
check-in with their friends for a few minutes. 

From 3 to 4 p.m., the students are back on task. Fifty 
stay in the cafeteria to participate in Power Hour, a 
time for finishing homework with the help of work- 
study students from the local university. Others 
return to their classrooms for tutoring. Working with 
their school-day teachers, who are paid extra to stay 
late, small groups of four to seven students receive 
the focused attention they need to master the con- 
cepts that have been introduced during the school 
day. Today, an additional 10 students are exempt 
from homework time because they have their 
monthly Youth Council meeting. The council’s 
agenda includes discussions about advertising for 
their upcoming community clean-up day of service 
and brainstorming to generate fundraising ideas for 
financing pizzas at their proposed teen dance night. 

At 4 p.m., students in each of these groups again 
shift gears to spend the following hour in a fun activ- 
ity of their choice. In one room, 18 students join the 
Game Club instructor to play chess, backgammon 
and monopoly. In the gym, an athletic instructor 
from the local YMCA helps students organize into 
teams and begin a lively game of flag football. 

At the same time, in the school’s home economics 
room, girls who are both new to the school and new 
to the country participate in what they call their 
Sweet 13 Club. Designed by program staff who recog- 
nized the challenges of assimilation faced by the 
school’s population of new immigrants, the club 
gives the girls an opportunity to make food, crafts 
and jewelry, as well as share in conversations about 
their transition experiences. 
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Other offerings today include a Computer Club, 
Science Club and Drill Team. The Drill Team is espe- 
cially popular — participants are working on a routine 
for the end of the year Family Showcase, a night 
when family members are invited to the school to cel- 
ebrate their children’s accomplishments. 

It is 5 p.m. when the students finally pack their bags 
and head outside to catch the school’s late bus home 
or wait for parents to pick them up. And while the 
ESS programs are all different in the specific pro- 
gramming they offer, they do, across the sites, pro- 
vide similar kinds of constructive activities within the 
safe and familiar environments of school buildings. 

The following pages present an overview of those 
programs across all of the ESS sites. To provide a 
context for the discussions in the remainder of the 
report, this chapter briefly describes what was 
involved in getting the programs started, their goals 
and offerings, the roles of partners and key staff, and 
how the programs have matured over time. 7 

How Were the After-School Programs 
Started? 

The after-school programs began with a vision, a rela- 
tively small amount of money, committed partners 
and a lot of persistence. Initial planning time was 
critical. The ESS programs each received a grant of 
$25,000 to $50,000 for a six- to nine-month planning 
period that allowed them to convene partners, assess 
community needs, strengthen relationships across 
organizations, pool additional community and finan- 
cial resources, and make early decisions about pro- 
gram implementation. Once implemented, programs 
operated the first year on an additional $80,000 to 
$300,000. 

Technical assistance can facilitate program start-up 
and implementation; and, importantly, all of the ESS 
programs received technical assistance as part of 
their involvement in the initiative. The organizations 
that had originally developed each of the four mod- 
els essentially acted as management consultants, shar- 
ing after-school resources with cities and helping to 
address specific concerns. 8 At the request of a pro- 
gram partner, staff from these organizations would 
visit programs, assess operations and make recom- 
mendations about how to address challenges. During 



the planning stage, they also gave local ESS planners 
the opportunity to visit active programs in other 
cities, and this helped to transmit a concrete vision 
of how after-school programs operate. In addition, 
they also hosted annual cross-site conferences that 
promoted sharing of information and generated 
enthusiasm on the part of participants. 



Why Were Partnerships important? 

Partnerships were central to developing ESS at each 
site and were expected to serve several important 
functions. These included: 

• Drawing on the existing resources and youth- 
serving expertise of multiple organizations; 

• Avoiding service duplication and service gaps 
among youth-serving organizations; and 

• Creating a stronger foundation for sustainability. 

Among the sites, the composition of these partner- 
ships varied to some extent, at least in part because 
each of the four ESS models had a different 
approach to promoting after-school collaborations 
(see box). 



Collaborative Focus of the Models 

The ESS programs are based on four different, nation- 
ally recognized models of after-school programs. 

Each model, in turn, is built on a somewhat different 
approach to collaboration: 

Beacon: 

Schools + fiscal CBO + lead agency CBO 

Bridges to Success: 

Schools + CBOs + local United Way 

Community Schools: 

Schools + CBO + a university 

WEPIC: 

Schools + a university 
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Whatever the model on which a particular site based 
its program, partners were initially attracted to ESS 
for a variety of different reasons. Roughly a third 
came because they viewed ESS as an opportunity to 
strengthen school-community partnerships. Another 
third viewed ESS as an opportunity' to expand what 
their own organizations were doing — ESS held prom- 
ise for generating additional funding and physical 
resources, such as the use of school space for activi- 
ties. The final third came to the partnerships simply 
because they were invited. 

Over the course of the planning period and first 
year of implementation, some of these initial part- 
ners decided to be more involved than others, and a 
few eventually decided not to participate. However, 
the reasons behind organizations’ initial motivation 
to become involved did not predict their future 
involvement. 

Ultimately, many organizations became partners in 
the initiative. CBOs represented a range of youth- 
serving groups, including the Girl Scouts, Boy 
Scouts, Big Brothers Big Sisters, the YMGA, and 
Campfire Boys and Girls. Institutions and agencies 
such as art museums, city libraries, and parks and 
recreation services also joined the partnerships. 
Other partners included the mayor’s office, county 
planning and grants offices, local businesses and 
rotary clubs — all of which were potential sources of 
contributed support or of assistance with fundraising. 
In some cases, partners played dual roles as both 
providers and funders of service. 

Because ESS programs operate within school build- 
ings, schools were especially critical partners. They 
were the gatekeepers to school space; contributed 
significant amounts of support, even beyond the use 
of their facilities; and often assisted in program 
development and youth recruitment by sharing cur- 
riculum ideas and supporting in-school suident refer- 
ral systems for ESS. In addition, administrators at the 
school district level were positioned to promote pro- 
gram expansion to other schools and, in some cases, 
to funnel state education dollars into programs. 



What Types of Schools Host the 
Programs? 

Because out-of-school supervision needs are greatest 
for younger youth, almost all of the after-school pro- 
grams were implemented in elementary and middle 
schools. Across the ESS programs, six take place in 
high schools, while 24 are in middle schools or jun- 
ior high schools, and 22 are located in elementary 
schools. 9 

These ESS schools are typical of urban schools across 
the country. They serve high proportions of minority 
and low-income youth, students’ academic perform- 
ance is reported to be low, and turnover among prin- 
cipals is relatively high — almost two-thirds of the 
schools have had two or more principals in the past 
five years. However, the neighborhoods in which the 
schools are situated can look very different from one 
another. For example, a middle school in Aurora, 
Colorado, is situated in a low-income, largely 
Hispanic neighborhood marked by wide streets and 
small one-level homes with modest yards and narrow 
driveways. A middle school in North Philadelphia, 
also predominately Hispanic, is located on a heavily 
trafficked bus route surrounded by small businesses, 
fast food chains and unbroken lines of rowhoines 
scarred by the occasional abandoned house. 

In some of the larger school systems, like 
Minneapolis, students are bused to school from many 
different neighborhoods. This transportation factor 
added an additional dimension of challenge to the 
task of recruiting youth and arranging for them to 
stay after school. In smaller school districts and ele- 
mentary schools, the fact that many students lived 
within walking distance alleviated, to some extent, 
this possible barrier to participation. 10 

What Are the Goals of the Programs? 

Across the ESS sites, project directors and site coordi- 
nators identified a number of major goals for their 
programs, including: 

• Improving youth’s academic performance; 

• Proriding an opportunity for youth to use their 
out-of-school time safely and productively; 

• Providing an opportunity for youth to develop 
positive relations with peers and adults; 
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• Having parents become more involved in their 
children’s lives and schooling; 

• Keeping youth off the streets and out of trou- 
ble; and 

• Providing youth with athletic and cultural expe- 
riences to enrich their lives. 

What Activities Do the After-School 
Programs Offer? 

To meet these goals, ESS planners in each city 
worked creatively with their host schools to fill gap 
times for children and youth. Although called “after- 
school” programs, ESS activities also run before and 
during the school day and throughout the year, 
including when school is not in session. All of the 
ESS programs offer after-school activities. In addi- 
tion, 70 percent offer summer programs; just over 
half offer weekend activities; and 37 percent offer 
activities during the school day, generally during 
lunch time. Twenty percent of the programs offer 
activities during school-year vacations, and 14 per- 
cent offer before-school activities. 

This report focuses exclusively on the programs dur- 
ing the after-school hours. It is important to note 
that these programs are very diverse. In fact, one of 
the advantages of school-based, after-school pro- 
grams is that they can be tailored to the specific pop- 
ulation of each particular school. But at the same 
time, the types of activities in which youth engage are 
generally similar across the sites. 

In almost all of those programs, academic activities 
are a primary focus — they include tutoring, home- 
work help, and specific academic classes like environ- 
mental science and computers. 11 Cultural enrichment 
activities such as art, music, sports and recreational 
activities like karate and open-gym time are also sta- 
ples in most programs. ESS staff have recognized the 
importance of giving youth recreational or down 
time after school, and those activities are often 
offered immediately after academic sessions like 
tutoring and homework help because they give stu- 
dents an incentive to complete schoolwork. 

Free-time activities such as snack-time or teen hang- 
out time are offered at more than half of the pro- 
grams, as are community service activities and 
specific classes to promote youth leadership and 



decision-making. However, fewer hours are spent on 
these. Free-time activities sometimes run for just 15 to 
30 minutes a day, and community service projects like 
cleaning a park or visiting a home for senior citizens 
are often offered just one day a month. Activities 
designed to help students with career preparation 
are the least common. This is primarily because the 
majority of youth served by ESS are not yet in high 
school, the time when career preparation activities 
are most important. 12 

How Do the Sites Attempt to involve 
Parents? 

Parents have been involved in the ESS initiative in a 
number of ways. As the programs were being 
planned, sites attempted to recruit parents to be part 
of that process. 13 In addition, many of the sites see 
part of their mission as serving the larger commu- 
nity, not just school-aged youth. During the first year 
of ESS, activities for youth were the main focus. 
However, as these activities got off the ground and 
stabilized, programming for parents and other com- 
munity residents received increasing attention. By 
the third year of the initiative, almost half (46%) of 
the ESS programs were offering adult classes, which 
have included academic support courses like GED 
preparation, English-as-a-Second Language, parent- 
ing skills and health education. Several programs 
also offer enrichment classes such as sewing, aerobics 
and tennis. At some of the sites, staff planned their 
adult classes by conducting parent surveys that asked 
about activity preferences. 

Beyond offering these separate weekend and evening 
sessions for parents, program staff worked to involve 
parents in their children’s experiences in the after- 
school programs. While recognizing that parent 
involvement is typically one of the most difficult chal- 
lenges faced by schools, ESS staff found that main- 
taining contact with parents helps promote student 
engagement, positive behavior and stronger aca- 
demic performance. They also found this type of out- 
reach is consistently valued by school principals. 

Programs have implemented different strategies to 
engage parents. Some sites send home newsletters, 
call parents with updates and concerns, or chat with 
parents who come to pick up their children. A few 
programs regularly invite parents to the school for 
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coffee and snacks, and some hold family celebrations 
or parties once or twice a year. Family celebrations 
served to showcase student accomplishments 
through performances and awards presentations, 
and staff feel this approach makes parents’ time at 
the school especially positive. 

How Are the Programs Staffed? 

Strong staffing is a core element of effective after- 
school programs. Across the sites, staff include: 

• A program director. The program director 
administers one or more after-school programs 
in a city and is responsible for the broader 
external tasks of forming partnerships, oversee- 
ing other staff, managing the budget, and rais- 
ing funds to implement, sustain and expand the 
programming. Approximately three-fifths of the 
ESS cities have full-time program directors; the 
others have part-time directors. Strong full-time 
directors with skills in diplomacy, networking 
and staff leadership seem pivotal in generating 
program stability and success. 

• A site coordinator. At the school-level, most pro- 
grams hired a full- or part-time site coordinator, 
who is responsible for implementing and 
administering the program at the school. This 
involves leading recruitment and enrollment 
efforts, planning and scheduling the youth 
activities, identifying activity providers, commu- 
nicating with parents, and providing daily over- 
sight of the program, including handling the 
logistics of arranging transportation home for 
participants and covering custodial needs. 
Because coordinators are usually located in an 
office at the school, they also serve as strategic 
intermediaries between school staff and part- 
nering agencies. 

• Activity providers. Whether teaching jewelry 
making, running a math club, coaching frisbee- 
golf or leading a book group, enthusiastic and 
caring activity providers bring the after-school 
programs to life. They include staff from part- 
nering agencies, teachers from the school, inde- 
pendent professionals, community residents 
and college students. Typically working just 2 to 



10 hours a week, they are often hired relatively 
inexpensively, yet play a vital role. 

One essential task the programs face is orient- 
ing the activity providers toward positive youth 
development philosophies and practices. These 
front-line staff spend more time with youth than 
do other program personnel but are sometimes 
only in the school a few hours a week. To ensure 
program quality, directors and site coordinators 
have to maintain ongoing communication with 
the activity providers, sponsor trainings and con- 
duct regular activity reviews. 

Across the sites, a panoply of additional staff support 
the after-school programs. Some have full-time sup- 
port staff to handle clerical work and provide 
administrative aide. In addition, some sites contract 
with school security officers and janitors to allow for 
continued safety and clean-up at the end of the 
school day. 

The sites also receive essential administrative support 
from their lead agencies — the CBOs or universities 
with whom they are collaborating. In general, the 
agencies contribute 2 to 10 hours a week; and this 
assistance from account managers, payroll staff, data 
collection specialists, grant writers and administrative 
assistants helps programs with fundraising and their 
ongoing financial operations. 

Finally, programs also recruit volunteers to fill gaps 
in services. These include VISTA and AmeriCorps 
volunteers who help coordinate and provide youth 
activities; high school and college tutors who run 
homework and academic support sessions; and 
adult volunteers who serve as mentors for higher- 
needs youth. 

Almost three-quarters (71%) of the programs report 
having 11 or more volunteers contribute their time 
during the course of a program year. The presence 
of these volunteers has helped lower the adult-stu- 
dent ratio during activities and provided additional 
opportunities for youth to form relationships with 
adults or young adults. However, programs also 
reported facing challenges in connection with their 
volunteers, including clearly defining volunteer roles, 
providing training and support so the volunteers can 
perform well in those roles, and haring the volun- 
teers show up consistently. These challenges are fairly 
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typical for organizations that rely on volunteers for 
the provision of ongoing, direct services. 

How Have the Programs Matured? 

During the three years the sites have been up and 
running, they have been strengthening their rela- 
tionships with the schools and improving the quality 
of their programming. 

In our two earlier reports, we documented the chal- 
lenges of developing relationships between schools 
and the agencies running after-school programs. 14 
Most of the youth-serving organizations began as 
guests in the schools, and it took time for schools 
and agencies to develop common understandings 
about the roles of the after-school programs and how 
they would operate. 

Creating ways of sharing and maintaining school 
space was especially critical. After-school programs 
needed regular access to classrooms and other space 
for activities, while schools needed assurance that 
those spaces would be well maintained. The costs of 
added wear and tear on school facilities caused by 
their additional use was not anticipated in the origi- 
nal grant proposals. Some programs addressed the 
issue by renegotiating custodians’ schedules so they 
would be available in the evening; some made 
arrangements to hire custodians for additional 
hours. Establishing these logistics proved essential for 
strengthening the school-program relationships. 

By their third year of operations, only two of the pro- 
grams were experiencing any real difficulty in work- 
ing with school districts; and almost three-quarters of 
the programs reported that the school districts were 
^willing or very willing” to accommodate the needs 
of ESS. In many cases, these relationships had grown 
stronger over time. More than three-fifths (61%) of 
the programs said school district support had 
increased over the past two years. 

The developing relationships were apparent to 
school personnel and ESS staff alike. Principals said 
they were pleased with their level of communication 
with program staff and, in several cases, noted that 
they considered ESS staff to be school staff. In those 
schools, along with some others, ESS staff were 
invited to attend school faculty meetings. 



Similarly, after-school staff reported feeling more wel- 
comed in the school and said that they worked hard 
to keep school administrators up to date on their pro- 
gram operations. The vast majority (83%) of site coor- 
dinators met informally at least once a month with the 
principal or assistant principal, and three-fifths also 
had regularly scheduled formal meetings. ESS staff 
also noted that their programs had become more 
widely recognized in the schools, helped, in part, by 
access to the schools’ public-address systems and by 
establishing procedures that encouraged teachers and 
counselors to refer youth to the programs. 

As the ESS sites have matured, they have also become 
more able to identify and address their core pro- 
gramming goals. In the survey administered in 
Spring 2001, 55 percent of site coordinators reported 
that over the course of three years, their programs 
increased their focus on youth development, and 49 
percent reported an increased focused on academics. 
(The answers were not mutually exclusive.) 

A number of programs also became more invested 
in developing ways to monitor activity quality, by 
using three approaches: programs established for- 
mal proposal review systems for selecting which 
activities would be allowed to run; site coordinators 
conducted formal or informal activity observations 
and then gave feedback to staff; and provider staff 
and students were given opportunities at the end of 
sessions to evaluate the strengths and weaknesses of 
specific activities. 

However, establishing and maintaining formal sys- 
tems created additional work for coordinators, who 
were already very busy. For this reason, even during 
their third year, some programs had still not set up a 
system of assessing activity quality and, instead, relied 
on informal student, staff and parent comments 
about how activities were going. 

During the past three years, the programs’ growth 
was marked by both challenges and accomplish- 
ments. The following chapters focus on findings 
from 10 of the programs to examine what they have 
accomplished and how, and where the ongoing chal- 
lenges reside. 
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111. Who Comes to the The most fundamental goals of the ESS programs 

After-School Programs? were to serve as safe places for children and y° uth in 

^ the after-school hours, and to provide opportunities 

and supports that would help them develop aca- 
demic and social skills. Thus, participation pat- 
terns — who came to the programs and how often 
they came — are the first indication of how well the 
programs would be able to accomplish their goals. 

A number of factors can affect participation patterns. 
The most obvious have to do with program charac- 
teristics. The ESS planners all had to make decisions 
about the goals and design of their programs that 
ultimately had an effect on which children and youth 
chose to participate and how often they attended. 

At each site, planners had to decide, for example, 
whether the program should function, in part, as 
child care for parents; whether some activities, such 
as tutoring, would be required for everyone who 
enrolled; and whether students would be required to 
enroll for five days a week of activities or could 
choose to attend only on the days that offered the 
activities most appealing to them. 

Viewed in this context, parents’ choosing to register 
their children for ESS and youth’s participation can 
be interpreted as signals of how well the programs’ 
structures and activities fit with the particular needs 
and desires of the communities they served. (See 
sidebar on next page for an overview of sites’ recruit- 
ment strategies, another factor that influences partic- 
ipation.) 

While information on the extent to which youth par- 
ticipate in after-school programs is now beginning to 
emerge , 15 much remains to be understood concern- 
ing the factors that affect participation and how to 
best increase the likelihood of meaningful levels of 
attendance. As community-designed, school-based 
programs, the ESS sites’ early experiences with par- 
ticipation patterns seem likely to provide lessons that 
can be useful to new and developing after-school pro- 
grams around the country. 
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The following chapter thus explores four fundamen- 
tal questions: 

• Which children and youth participated in the 
after-school activities? 

• How often did they attend? 

• What factors helped account for the patterns of 
participation? 

• What are the implications of these findings for 
policy and practice? 



Recruiting Students for the After-School 
Programs 

Recruitment strategies have an obvious influence on 
who participates: and in developing their strategies, 
ESS staff were sensitive to the obstacles that could 
prevent youth from enrolling in programs. The most 
obvious banners are that parents may not be aware 
that the programs exist, unaware of key features such 
as whether the activities are free or unsure how to go 
about registering their children. 

Thus. ESS staff conducted outreach and registration 
activities in a variety of ways, with the aim of maxi- 
mizing students’ and parents’ knowledge of the pro- 
grams and increasing the convenience of the 
registration process. Their strategies included: 

• Mailing notices about ESS to parents and sending 
notices home with the children over a period that 
generally extended for two or three weeks before 
and after the start of activities. 

• Providing information about ESS through direct 
contact by calling parents at home or talking to 
them when they came to pick up their children at 
school. 

• Holding open houses in the evening where parents 
could hear about activities in the upcoming semes- 
ter and sign their children up on the spot 

• Holding information and registration sessions in 
public housing complexes where many of the stu- 
dents lived. 

• Translating notices into appropriate languages in 
communities where children’s parents spoke lan- 
guages other than English. 



The chapter draws on information concerning 1,511 
first to eighth graders who enrolled in the ESS partic- 
ipation study at the 10 intensive research sites 
between Fall 1999 and December 2000. Data include 
program-provided participation records, demo- 
graphic information provided by parents on the 
enrollment forms, and responses to surveys com- 
pleted by the youth and their parents. 16 



Who Enrolled? 

Even as relatively new options, the ESS programs 
seem to have been attractive to the children and par- 
ents in their schools. As early as the 1999-2000 school 
year (in most cases, the second year of operations), 8 
of the 10 programs considered themselves to be oper- 
ating at capacity — serving as many students as they 
could widiin their available resources. Interest in the 
after-school programs was so high, relative to available 
resources, that three of those programs capped their 
enrollments during one or both of the years covered 
by this study. And one program, in its effort to meet 
the demand for registration, limited the number of 
days a week for which youth could register. 

Across the 10 sites, programs served an average of 63 
youth a day. In most of the sites, however, different 
youth attended on different days of the week, so the 
number of individual youth served is much higher. In 
fact, across the eight sites that collected participation 
data on all youth who were enrolled in ESS (not just 
those enrollees who were registered for this study), 
slightly more than half of the schools’ total popula- 
tions were participating in the after-school programs. 

In general, the ESS participants reflected the popu- 
lations of their schools. As Table 1 illustrates, across 
the schools, participants were quite diverse and 
from families that had a range of income and edu- 
cational achievement. At the same time, the sites 
were generally successful in reaching out to low- 
income families for whom free, school-based pro- 
grams such as ESS may be a valuable resource, 
providing safe, supervised places for their children to 
be after school, as well as an array of perhaps other- 
wise unaffordable activities. Almost three-quarters of 
families had incomes of $30,000 or less, and almost 
the same proportion were eligible for free or 
reduced price lunch. 
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Selected Family and Background Characteristics of ESS 
Participants : ' : 

Gender 

Female 54.7% 



less likely to have time to focus on the details of the 
program and registration. 

Staff and partners at the ESS programs were keenly 
aware of the characteristics of students who were less 
likely to enroll in the after-school activities. One 
teacher noted: 



Male 45.3% 

Average age in years 1 0.3 

Ethnicity* 

White 40.1% 

African-American 32.7% 

Hispanic 19.4% 

Asian/Pacific Islander 7.7% 

Native American 3.0% 

Other 3.8% 

Child lives in single-parent household 41.1% 



I think some of them don 't have good reading skills 
so they don 7 want to do another hour of reading 
after school 

And a staff member at a partnering agency said: 

With the after-school program, it’s seemed to only 
hit the kids with highly functional parents who are 
getting the applications back... It's the kid that does- 
n 7 have a parent who can read that were missing. 



Parent education 




Not a high school graduate 


22.4% 


Some coilege/comm unity college 


30.0% 


College/community college graduate 


23.7% 


Annual household income 




$14,000 or less 


37.5% 


$30,000 or less 


73.9% 


Child receives free/ reduced-price lunch 


71.8% 



* Ethnicity categories are not mutually exclusive and, thus, do not 
add up to 100 percent. 

Source: Intake data collected from parents or guardians at the time 
of enrollment into study. 



The Speciai Challenges of Attracting High- 
Needs Youth 

Although they were successful in recruiting low- 
income youth who reflected the demographics of 
their schools, the ESS programs felt they needed to 
do more to attract and serve the most high-needs 
youth — those who were disengaged from school, fail- 
ing courses and exhibiting negative behaviors. These 
youth are typically difficult to draw in and retain in 
after-school programs. They are less likely than youth 
with fewer problems to be comfortable in organized 
programs, and may resist school-based activities if 
they are experiencing problems with learning. In 
addition, their parents may also be under stress and 



In contrast, as one principal said, students who do 
tend to enroll are those who “would take advantage 
of any opportunity there was.” And one teacher 
noted: 

They [the most likely ESS participants] are more 
confident... They re bigger risk takers. I think 
they 've had more opportunities outside of school. 

They 've had Brownies or Scouts. . . They 've gone 
camping , and they vjant to do it again. 

To engage greater numbers of the most high-needs 
youth, ESS staff developed targeted strategies to 
specifically address some of their barriers to partici- 
pation (see sidebar on next page). These efforts do 
seem to have resulted in gains, at least as suggested 
by an increase in the proportion of ESS youth who 
were eligible for free or reduced-price lunch. 

During the two years of this study, the number of 
enrollees in that category increased from 66 to 72 
percent — a percentage that almost precisely 
reflected the demographics of the schools. But 
despite these successes, programs recognize that the 
youth most in need of academic and developmental 
support typically still do not join, and they continue 
to look for new approaches for reaching them. 
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Strategies for Attracting High-Needs Youth 

ESS programs developed several strategies to 
increase their ability to attract high-needs youth. For 
example, some programs: 

• Worked closely with teachers and other school 
staff to identify and encourage such students to 
enroll. In addition, at some sites, teachers recom- 
mended the program to parents during parent- 
teacher conferences. 

• Reserved enrollment slots for high-needs youth 
who were referred to the program in this way. This 
was essential in programs where the number of 
registrants was capped, Otherwise, all slots might 
be filled by youth whose families were more com- 
fortable and familiar with organized activities and, 
thus, quicker to register. 

• Hired staff to lead activities that had personal char- 
acteristics to draw in youth who were disengaged 
in school. These staff tended to be representative 
of participants in gender and race, and closer to 
them in age. 

Some programs also offered opportunities for less- 
structured activities, such as open-gym activities or 
teen rooms, to attract youth who might feel more 
comfortable in a casual environment. 



How Often Did Youth Attend? 

Two of the major policy concerns driving the interest 
in after-school programs are the desire to provide 
youth with academic and developmental supports 
and opportunities, and to keep them safe during the 
after-school hours. Thus, it is important to know 
whether enrollees are attending often enough to 
make these goals attainable. 

Table 2 describes youth’s attendance rates and patterns 
across the 10 programs in the study. In a typical semes- 
ter, participants were, on average, registered for 33 days 
of the program, or roughly three days a week, and they 
attended almost two-thirds (63%) of those days. This 
attendance rate translates to 20 days of participation per 
semester, or about two days a week. However, averages 
for the 10 schools were strongly affected by high levels 
of participation at one school. If that school is excluded, 
the average number of scheduled days drops from 33 to 
27, and average days present drops from 20 to 15. 



It is important to note that many youth participated in 
ESS over time, not just for one semester. More than a 
third (35%) attended the after-school program for all 
four semesters of the study. Nearly half (49%) partici- 
pated for three semesters, and 84 percent participated 
during two semesters. Thus, there was opportunity for a 
cumulative effect from the program’s activities and sup- 
ports. 17 But there were also gaps in registration when 
former participants did not re-enroll. This was particu- 
larly true from one school year to the next, when spring 
enrollees did not return for the following fall semester. 
While we do not have direct information on why stu- 
dents did not continue in ESS from semester to semes- 
ter, one likely contributing reason is the high level of 
student mobility that characterizes schools in poor 
neighborhoods. 

When considering the extent of participation in ESS 
and its potential benefits, it is also important to keep 
in mind that many of the youth were engaged in 
other activities in addition to ESS. In fact, partici- 
pants reported they typically spent one or two more 
days a week in organized after-school activities in set- 
tings other than school. However, even while they 
said they spent much of their after-school time in 
supervised settings, a non-trivial proportion of their 
time was unsupervised — more than half of the youth 
typically spent some part of their after-school hours 
each week without adult supervision. (The way youth 
spend their after-school time will be discussed more 
fully later in this chapter.) 

What Factors Help Explain Participation 
Patterns? 

Across the 10 sites, there was wide variation in the 
number of days youth attended the after-school pro- 
grams during a typical semester. The average number 
of days that youth scheduled for ESS ranged from 
18.6 to 84.6 across the 10 programs; their attendance 
rates varied from 34.4 percent to 73.9 percent; and 
the number of days they actually attended ranged 
from 10 to 62. 

Three key, sometimes interrelated factors seemed to 
contribute to these variations: the ages of the youth; 
choices made by programs about whether they would 
require five-day-a-week enrollment; and preferences 
of both youth and their parents concerning how the 
youth spend their after-school hours. 
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Table2: 



Average days program was open per semester 

Average days scheduled by participant per semester 

Average days present per semester 

Average days present per week 

Distribution of average days present per semester 
(by percent of youth): 

1-4 days 
5-19 days 
20-39 days 
40 or more days 

Average youth attendance rate— days present of days scheduled (%} 63.0% 

Source: Site-entered participation data for 1,511 youth for 1999-2000 and 2000-2001 school years. Includes only youth who participated for at 
least one day. 
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Grades 1-3 


Grades 4-5 


Grades 6-8 


59.5 


60.3 


60.8 


58.1 


33.0 


39.2 


32.6 


28.7 


20.0 


28.1 


21.2 


13.4 


1.9 


2.2 


1.9 


1.6 


14.4% 


6.8% 


7.4% 


23.5% 


51.6% 


47.0% 


54.7% 


53.3% 


21.2% 


21.7% 


23.8% 


19.6% 


12.8% 


24.5% 


14.1% 


3.6% 


63.0% 


72.6% 


66.8% 


53.9% 



Age of Participants 

The strongest predictor of greater participation was 
the age range of the youth. In a typical ESS session, 
younger children attended, on average, substantially 
more days than older youth. As Table 2 illustrates, in 
a typical session, younger children were both sched- 
uled for more days of participation and had a higher 
attendance rate. For example, children in grades 1 to 
3 attended, on average, 28 days (73% of their sched- 
uled days), while sixth through eighth graders 
attended an average of only 13 days (a 54% atten- 
dance rate). 18 

In addition, a much higher percentage of those 
younger enrollees attended for more days during a 
typical semester. Among the participants in grades 1 
to 3, 46 percent attended for 20 or more days. 
However, among sixth to eighth graders, only 23 per- 
cent of enrollees attended 20 or more days, and 
almost a quarter attended four days or fewer. 

Parents’ concerns seemed to influence their chil- 
dren’s attendance patterns, and those concerns 
tended to correlate with their children’s ages. When 
asked why they registered their child in ESS, parents 
of children in grades 1 to 3 were far more likely than 



parents of middle school students to say that they had 
done so because the program offered opportunities 
for academic improvement and provided a safe place 
for their child to be after school. And it was parents 
who cited these reasons for enrollment whose chil- 
dren attended more days of ESS — 15 days or more in 
a typical semester. 19 

Mandatory versus Flexible Enrollment Policies 

ESS planners at each site had to make a number of 
decisions about programming that would influence 
which students ultimately enrolled in the after- 
school activities and how often they attended. For 
example, planners who decided that the program 
should serve, in part, as child care for parents would 
be more likely to mandate, or at least allow, five-day- 
a-week enrollment. Planners who decided that tutor- 
ing would be a daily required activity for each 
participant might, through this decision, discourage 
youth from attending who felt the most frustrated 
with academics and wanted to avoid any additional 
classroom-like work. 

Planners’ decisions inevitably involved some trade- 
offs. Perhaps the most obvious example of this con- 
cerns the choice of whether to require five-day-a-week 
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Increasing Attendance Rates 

After-school programs that require five-day- a- week 
enrollment often struggle with low attendance rates. 
However, one ESS program has been able to achieve 
a high attendance rate (72%) despite its five-day-a- 
week mandate. There are several factors that con- 
tribute to its success. The program: 

• Serves children in grades k-5. Elementary 
school-age students typically attend their sched- 
uled after- school activities more frequently than do 
older youth. In part, this may be because the chil- 
dren have to attend when their working parents 
rely on the program for child care. 

• Enforces a strict attendance policy. The program 
communicates its expectation that enrolled stu- 
dents will participate every day. It limits slots to 

1 1 7 children and has a waiting list of others who 
want to enroll. Thus, children scheduled but not 
attending are literally depriving other students and 
families of services. 

• Provides a strong link between the after-school 
activities and the in-school experiences of stu- 
dents. The program has a strong academic focus, 
and many of the participants are recommended by 
their teachers based on academic and youth 
development needs. 

In addition, the program is required by one of its fund- 
ing sources to charge participants' families a fee. with 
amounts varying based on a family’s ability to pay. 
(The average rate is approximately $20 per week, but 
some families pay as little as $2.) Since parents are 
paying for the program’s services, they may take extra 
measures to ensure that their children attend. 

Finally, the program provides bus transportation home 
each day, although bus schedules require that stu- 
dents needing transportation leave more than an hour 
before the program ends. 



registration or to allow, or even mandate, more flexi- 
ble scheduling. 

Programs that require registration for five days a 
week have, not surprisingly, resulted in more days of 
attendance for participants than flexible programs 
that permit registration for fewer days. 

However, there are also suggestions that, overall, 
greater numbers of low-income students participate 



when they have the option of scheduling activities for 
fewer than five days a week. 20 

The 10 ESS programs included in this study are 
spread across die continuum of M five-day-a week” to 
“flexible” approaches to registration, and their place 
on the continuum may explain some of the variation 
in patterns exhibited across the schools that extend 
beyond differences in the ages of participants. 

Three of die 10 programs offered activities five days 
a week and generally did not permit registration only 
for selected days. In those programs, participants, on 
average, attended for more days than at the other 
sites. However, two of the three also had the lowest 
attendance rates (average attendance of lower than 
40%) among all 10 programs. 

These low rates of attendance suggest that scheduling 
for five days without enforcing an attendance policy 
increases the likelihood that youth will not show up 
regularly. However, other factors might also have con- 
tributed. The five-day-a-week site with high attendance 
rates was an elementary school, while participants at 
the other two sites were middle school students. 

Unlike the elementary school program, the middle 
school sites did not have a well-articulated — and 
enforced — attendance policy. In addition, the middle 
school programs did not provide transportation home 
at the end of the after-school day, a factor that could 
discourage attendance on days when alternate forms 
of transportation were unavailable. (See sidebar for a 
description of the elementary school program’s strate- 
gies for achieving high attendance rates.) 

The other seven programs allowed selective registra- 
tion for activities offered only on certain days (or, in 
the case of one site, limited registration to fewer days 
than the program was open). This flexible enroll- 
ment policy helped programs meet the demand for 
services and, perhaps, allowed them to increase the 
variety of their offerings. The programs would, for 
example, schedule a dance class on Monday and 
Wednesday and a chess club on Tuesday and 
Thursday. Parents would then register their children 
for specific activities and not others; and, as a result, 
the children often enrolled for fewer days than the 
programs were open. 

These practices increased the number of youth who 
participated in the programs, and they may also have 
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helped attract a greater range of youth because they 
could enroll only for the specific activities that 
appealed to them. The tradeoff, however, was that 
individual youth participated for fewer days each 
week and, thus, were less often in the “safe haven” of 
after-school programming, with its potential for pro- 
viding academic and developmental supports and 
opportunities. In addition, flexible enrollment poli- 
cies may limit the after-school program’s usefulness 
to parents with child care needs. 

Interestingly, among parents who completed a survey 
in Spring 2001, a high percentage (42%) cited the 
effect of program policies limiting participation as a 
key reason for their child not attending more fre- 
quently, suggesting that, in sites which limited enroll- 
ment, many parents would have liked their children 
to be able to enroll for more days. 

Youth’s and Parents’ Explanations of Why Youth 
Did Not Attend More Often 

Youth, of course, have a voice in how they spend their 
time after school, and these preferences also seemed 
to affect parucipation rates. In the Spring 2001 sur- 
veys, ESS enrollees and their parents were asked why 
the youth did not attend more often, including why 
they did not schedule ESS for more days a week and 
why they did not attend a higher percentage of their 
scheduled activities. Table 3 lists their most frequent 
responses (they could give muldple reasons). 

Table .pr * ^ •' ^ 

Youth and Parent Reports^ T J 

Why Youth Did Not Attend ESS More Often Ji 

Youth Report 

Had other things to do elsewhere 28% 

Not interested in activities, or 

friends did not attend 18% 

Did not have a way to get home 15% 

Did not like treatment by staff or other students 1 1 % 



The youth who attended ESS the fewest days in a 
typical session were significantly more likely to have 
given the first reason for their non-attendance — 
they had other things to do elsewhere. (See sidebar 
for what those “other things” included.) While they 
generally expressed positive attitudes about the ESS 
activities as interesting and as valued sources of new 
learning and skills, they also made it clear that 
there were a number of ways they spent their after- 
school time and that these could draw them away 
from ESS. 

It is important to note that it was older youth, 
rather than children, who were more inclined to 
give the second reason for non-attendance — they 
were not interested in the activities. Alternative 
activities available to them are likely to be more var- 
ied than for younger children; for example, they 
may have more types of team sports to choose from. 
And older youth indicated more often than younger 
children that they simply went home or to a friend’s 
house after school. In addition, parents of older 
children may allow them to more frequently “opt 
out” of organized activities. Children in grades 1 to 
3 are, obviously, far less likely than middle-schoolers 
to make independent choices about how to spend 
their after-school time. 



How ESS Youth Allocated Their After- 
School Hours 

Fourth to eighth graders responding to a survey in 
Spring 2001 described how they spent their after- 
school hours during the previous week. They reported 
that they spent: 

• 1.8 days, on average, in organized activities, such 
as ESS, at their school. 

• 1.4 days in organized activities at locations other 
than the school. 

• .5 days in school for other reasons, such as using 
the library or talking to a teacher. 

• 3.2 days at their own or a friend’s home, or at the 
home of a sitter or relative. 

(Numbers add up to greater than five days because 
youth may have spent time in different ways in a 
single day.) 



Parent Report 

My child had other things to do elsewhere 42% 

My child did not like the activities, 

or friends did not attend 23% 

My child did not like treatment by staff or by 

other students 15% 

No transportation available for getting home 

after the program 1 5% 
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As Table 3 indicates, parents’ explanations for why 
their children did not more often attend ESS gener- 
ally supported reasons given by the youth. Two of 
these reasons for non-attendance — the child not lik- 
ing the activities and a lack of transportation home — 
were predictors of attendance patterns. Both were 
cited significantly more often by the parents of chil- 
dren with low attendance. 

What are the Implications of these 
Findings for Policy and Practice? 

Even in their early years of operations, the ESS pro- 
grams succeeded in attracting significant numbers of 
the young people in their schools and, in fact, were 
in most cases filled to the capacity of their resources. 
The participants generally mirrored the populations 
of their schools — for the most part, they were chil- 
dren from low-income families. The ESS programs’ 
successes and challenges in recruiting participants 
suggest the following “lessons” for policymakers and 
program practiti oners: 

• Some groups of children and youth are more likely 
than others to be attracted to school-based, after- 
school programs . In ESS, as has also been found 
in other after-school programs, younger chil- 
dren attended more frequently than older 
youth. In addition, the students who were most 
easily recruited for the program tended to be 
those who were already “joiners.” As the pro- 
grams developed, staff began to more specifi- 
cally target some of their recruitment strategies 
toward attracting the most high-needs youth 
(the “non-joiners”), students who were failing 
courses, were disengaged from school and had 
behavior problems. 

The “safe haven” and academic and develop- 
mental opportunities offered by after-school 
programs could be particularly valuable for 
both older youth and higher-needs children 
and youth. However, engaging them in struc- 
tured activities after school at levels that could 
help lead to skill-building and developmental 
progress is difficult. It seems likely that after- 
school programs, in general, would benefit 
from more information on attracting and serv- 
ing older youth and children and youth who 
have the greatest needs. 



* There are tradeoffs involved in the decision whether 
to require participation for four or five days each 
week or to allow youth to schedule their after-school 
activities more flexibly. In shaping the content and 
requirements of their programs, the ESS plan- 
ners made decisions that influenced how many 
youth and which youth enrolled and how often 
they attended. Requiring five-day-a-week enroll- 
ment obviously increased both the number of 
scheduled days and days attended, but allowing 
youth to register for only a few days a week 
meant that programs could serve a greater num- 
ber and, perhaps also, a more diverse group of 
youth. The ESS programs also found that requir- 
ing five-day-a-week enrollment resulted in low 
attendance rates unless they had a well-articu- 
lated and enforced attendance policy. 

• While , on average, students participated in the 
school-based, after-school programs for 20 days in a 
typical semester, they also tended to participate over 
an extended period of time, not just a single semester. 
The ESS after-school programs generally oper- 
ated for 11 weeks each semester, and registered 
students attended slightly less than two days 
each week, on average. While this relatively 
small number of days could suggest that partici- 
pants may not be attending often enough for 
programs to achieve their goals of strengthen- 
ing youth’s academic and social skills, it is 
important to understand that participants also 
attend these programs over an extended period 
of time. In the ESS sites, for example, more 
than a third (35%) of the enrollees participated 
all four semesters that were covered by this 
study and, overall, 84 percent participated in 
two or more semesters. These participation pat- 
terns suggest the possibility of a cumulative 
effect of less intensive participation over time. 

In addition, for many youth, ESS was only one 
aspect of their after-school participation in 
organized activities, and those other activities 
also have the potential of providing supports 
and opportunities for positive development. 

The following chapter explores die quality of the 
activities that youth experienced as they participated 
in the ESS programs. 
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The children and youth who came to the after-school 
programs participated in a range of activities that 
included remedial academics, academic and cultural 
enrichment, sports and recreation, and community 
service. (The sidebar on the next page describes the 
percentage of time devoted to each type of activity 
across all of the ESS sites.) 

But what was the quality of these activities? Among 
the goals of ESS was to foster positive youth develop- 
ment by engaging participants in quality after-school 
programs that provide the supports and opportuni- 
ties deemed essential for helping young people 
develop new skills and interests, build positive rela- 
tionships with adults and peers, and become involved 
in leadership and decision-making roles. 

Every activity has the potential to foster positive 
youth development. While individual activities may 
place differing emphases on how they go about pro- 
viding specific supports and opportunities for youth, 
practices that promote positive development should 
be present in some degree across each activity, what- 
ever the goal or content — whether it focuses on 
tutoring or other remedial academics; academic or 
cultural enrichment; community service; or sports 
and recreation. “Youth development” is not a type of 
activity but rather a set of practices that should be 
present in any activity. 

This chapter examines the quality of the activities 
provided in the after-school programs. It addresses 
the following questions: 

• What characteristics of activities are most likely 
to contribute to positive youth development? 

• To what extent did the activities in ESS provide 
youth with these developmental supports and 
opportunities? 

• What are the implications of these findings for 
policy and practice? 

To illustrate some of the features of high-quality 
activities, the chapter also describes three specific 
activities in more detail. 

Information for this chapter is drawn from observa- 
tions made during the 2000-2001 academic year of 30 
activities — including academic, enrichment and serv- 
ice activities — in three after-school programs for mid- 
dle school students. 21 
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Types of Activities in the After-School 
Programs 

Across the ESS sites, students participated in a range 
of activities. This list shows the percentage of total 
hours of programming that sites, as a whole, devoted 
to each type of activity: 



Academics 26% 

Enrichment' 21% 

Sports/recreation 21% 

Free-time 11% 

Community service 9% 

Leadership 9% 

Career preparation 3% 



* Includes cultural and some academic enrichment 
activities, and visual and performing arts activities. 

Source: Survey completed by 54 ESS programs in 
Spring 2001. 



What Dimensions of Activities 
Contribute to Positive Youth 
Development? 

Several basic conditions seem necessary if an activity 
is going to be a positive experience for youth. Staff 
need to present the activity’s goals and directions in 
a way that youth can grasp, and have a firm but posi- 
tive management style that neither stifles youth with 
too much control nor allows the room to become so 
chaotic that participants have difficulty doing their 
work. An appropriate staff-youth ratio also con- 
tributes to an activity’s success, as does having ade- 
quate space so that youth can work comfortably. 

Beyond these common-sense requirements, youth 
development theory and practice have identified 
four key features — or dimensions — of activities that 
are important for providing the supports and oppor- 
tunities that contribute to positive growth and 
change in the young people who participate . 22 
They include: 

1. Adult-youth relationships. A positive relation- 
ship between the activity leader and participants 



helps youth benefit from the activity. It con- 
tributes to a sense of belonging; makes them 
feel successful; and shows that the adult is a 
dependable source of social and emotional sup- 
port in and outside of the activity. 

2. Peer support. Activities can provide youth with 
support from their peers, both by contributing 
to the development of social skills and by pro- 
viding youth with opportunities to interact with 
one another in a positive way. Peer support 
plays a powerful role in youth development. 

3. Decision-making and leadership opportunities 
for youth. Youth feel their ideas are valued and 
respected, and that they are making an impor- 
tant contribution when they have opportunities 
to make decisions about, and help organize or 
run, the activities in which they participate. 

4. Youth engagement. If an activity is going to ben- 
efit youth, they should be challenged to learn 
and develop new skills. One indicator of the 
extent to which youth find activities interesting 
and challenging is their degree of enthusiasm 
and engagement during the activity. While 
being engaged in an activity does not automati- 
cally mean that youth are benefiting from it, 
they will not profit from an activity if they are 
not engaged — if they are bored, easily dis- 
tracted or uninterested in completing the task. 

It is important to note that most activities are not 
designed to be equally strong in all four of these key 
developmental features. Some activities that are 
weaker in one area may be very strong in others. For 
example, a tutorial activity will be less likely to 
include much peer support but may be strong in 
adult support because of the intense one-on-one 
attention that staff give individual youth. Similarly, an 
activity that is structured around teams of youth 
working together to develop and complete projects 
may be stronger in providing opportunities for peer 
support and decision making than in adult-youth 
relationships. 

Programs that offer a range of activities can create a 
balance across their offerings so youth ultimately 
experience all of the key features that contribute to 
positive development. 
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What Was the Quality of the ESS 
Activities? 

The ESS activities were, on the whole, well designed 
and well implemented. Among the 30 that we 
observed, ail but two provided at least some develop- 
mental supports and opportunities for youth. 23 This 
section describes the extent to which the four key 
dimensions were present in the ESS activities and 
provides more detailed discussions of three of those 
activities. (Table 4 illustrates the average score on 
each dimension in five types of activities.) 

Most activities were characterized by positive 
adult-youth relationships. 

In general, adults leading the activities provided 
youth with both instrumental and emotional sup- 
port. In fact, providing instrumental support — guid- 
ance to help youth understand and succeed at the 
task at hand — was what adults leading the activities 
were best at. (Two-thirds of the activities were rated 
very positively in this area.) 

The emotional support that youth received from 
adults was manifested in the interactions between 
staff and participants, which were, for the most part, 
warm, friendly and relaxed. This warmth was more 
apparent in enrichment and creative arts activities 
than in academic activities in which the adult-youth 
relationships were, in general, more formal or busi- 
ness-like, focused on the task at hand, and character- 
ized by fewer personal exchanges and little of the 
friendly joking and teasing that were apparent in 
adult-youth exchanges in other types of activities. 

However, while youth were not receiving high levels 
of emotional support from adults during tutoring 
and homework help, they were getting high levels of 
support that helped them understand and succeed in 
their work. One youth described the value of this 
kind of support: 



Observing Activity Quality 

How is it possible to identify the extent to which key 

features are present in activities? Observers can look 

for answers to questions such as these: 

Adult-youth relationships: 

• Does the adult help youth understand and succeed 
at the task at hand? 

• Does the adult respond to youth as individuals 
whose ideas merit interest, encouragement, 
respect and praise? 

• Do the adult and youth interact in a friendly and 
comfortable way? 

Peer support: 

• Do the activities encourage cooperative interaction 
by, for example, having youth work in groups, or 
do collaborative problem solving? 

• Do the youth seem supportive of, and comfortable 
with, each other? 

Decision-making and leadership opportunities: 

• To what extent do youth have input into planning 
an activity and deciding how to carry it out? 

• To what extent are there opportunities for youth to 
take formal (assigned) or informal leadership roles 
by, for example, assisting with tasks, helping other 
youth, or serving as team captains or group lead- 
ers? 

Youth engagement: 

• To what extent are youth actively participating? Do 
they seem interested in completing the activity or 
are they just going through the motions? Are they 
focused or inattentive? Do they appear to be hav- 
ing fun? 

• To what extent do youth show in their comments 
and/or behaviors that the task is at an appropriate 
level of difficulty? Do they appear to be frustrated 
because the activity is too hand, or bored because 
it is too easy? 



Like, if you don ’t understand something, she keeps 
repeating it so you understand it, till you get it 
Like, if I was having a problem with... using the 
angle tiller or something, she would show me again 
and teach me how to use it again. 
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Instrumental Support* 


3:2 


3.9 


4.4 


3.2 


4.3, 


Comfortable Adult-youth relationships 


3.3 


3.2 


4.3 


3.6 


4.K 


Cooperative peer behavior 


3.3 


2.6 


4.0 


3:7 


2.1 


Comfortable Peer relationships 


3.5 


3.0 


3.9 


3.9 


3.8 


Decision-making 


2.3 


1.1: , 


3.0 


2.7 


1.9 


Leadership 


3.3** 


1,2 


2.0 


2.3 


1.1 


Youth engagement 


3.2 


3.4 


4.1 


4.1 


4.1 


Number of activities*** 


4 


5 


8 


7 


3 



* “Instrumental support” refers to the extent to which the adult helped youth understand and succeed at tasks involved in the activity. 

** One activity significantly raised the average “leadership” rating in this category. 

*** The chart includes 27 of the 30 activities we observed. Three are excluded because they did not fit any of the categories of activities. They 
include a sports activity, a discussion group on various teen issues, and an activity that crossed multiple categories. 



The academic activities were very task-oriented: their 
purpose was to complete homework and/or master a 
specific set of academic concepts or skills. Thus, 
whether or not they were taught by a teacher, they 
incorporated aspects of the classroom. More than half 
of the academic activities were led by teachers, which 
might seem to suggest that the activities were less 
warm and friendly because teachers maintained the 
formal and task-oriented teacher-student relationship 
that exists during the school day. However, teacher- 
led enrichment activities in other areas, such as cre- 
ative arts, were just as warm and friendly as 
non-teacher led activities in those categories. 

in general, the after-school activities provided 
youth with a supportive peer environment. 

In more than half of the activities we observed, the 
quality of peer interactions was very positive. Youth 
seemed comfortable together, laughed and joked, and 
seemed to enjoy each other’s company. Importantly, 
one of the things that seemed to affect the quality 
of peer interactions in an activity was the quality of 
the adult’s relationships with the youth, suggesting 
that the adult sets the tone for peer relations. (See 
the boxed description of a chess club that illustrates 
this connection.) 

But while the interactions among youth were, for the 
most part, quite positive, only a third of the activities 



provided opportunities for high levels of peer coop- 
eration. Small group projects provided the most 
opportunities for youth collaboration and teamwork, 
while academic activities and visual art activities 
where youth worked on their individual projects pro- 
vided few opportunities for this kind of cooperative 
interaction. 

Activities provided far fewer opportunities for 
decision making and leadership. 

Overall, only a few of the ESS activities provided 
opportunities for decision-making: six were rated 4 
or better, while 15 received ratings of less than 2 in 
this area. Youth-driven and open-ended activities (the 
final product or goal was not predetermined by an 
adult) offered youth the most decision-making 
opportunities. These were generally cooperative 
group activities where youdi worked together on 
projects. 

However, some of the art activities, while carried out 
individually, were also open-ended and, thus, pro- 
vided many decision-making opportunities for partic- 
ipants. For example, during one activity where youth 
were working in clay, the instructor asked them to 
pick a theme for their projects and explained that 
the individual clay pieces they made would be related 
to the theme and would be displayed at an art show 
at the end of the semester. After discussing various 
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What Works? 

Chess Club: Strong Adult-Youth Relationships Creating Positive Peer Dynamics 



What it is: The chess club, an activity for sixth to eighth 
graders, is led by a teacher at the school. Sessions take 
place four days a week, are attended by about 20 youth 
(almost all of them male) and lasts for two and a half to 
three hours. As a member of a state chess league, the club 
also competes weekly with other middle and high school 
chess clubs. 

Why it is being highlighted: This activity illustrates how 
the quality of the adult-youth relationship can set the tone 
for positive peer dynamics. It also exemplifies how an adult 
can heighten and sustain youth's interest in an activity and 
make the activity challenging. That, in turn, motivates and 
engages the youth. 

How it works: The teacher wants to develop the students’ 
chess skills and love of the game. He has a library of 60 
chess books that the youth can borrow and he helps them 
select books appropriate to their level. He also bought a 
computer program to help the kids build their skills. 

To develop their skills, the youth sit at a long table and, 
play in pairs or against the teacher, who plays against sev- 
eral youth at a time on different chessboards while moni- 
toring all the other games: He communicates an 
enthusiasm for the game and a belief that the players can 
become better with experience. When a youth wins a 
game, the teacher praises his great moves. He then chal- 
lenges him to further develop by asking him to play with a 
more advanced player. The good players seem to take 
pride in being called on to help others learn the game. 

When a less experienced player loses a game, .the teacher ;:;^. . •; .f -y . * •:••••••?• 

turns the youth’s attention not to the loss but to his potent f As a result of the teacher's skill; in motivating the youth, his ; 

: tial to win by pointing out that the winner had far more ability to help them develop their skilis and the team spirit?. I>: 

experience. “You are just starting out;’’ he says, “and you 5 that fills the; room, youth are highly engaged in this activity: f; 
almost wonlT C X They focus intensely on their own games and, when they JJ.. 

' ■ v ' ; v v 4i : X :• 1;^ • -are finished;; watch their peers- play. In Tact,, the youth are> - x 



Why it works: The teacher uses chess as a vehicle for 
developing character, perseverance and problem-solving 
skills that can be applied to situations beyond the chess- 
board. He: 

• Fosters the strategic problem-solving skills that chess 
requires by giving constant encouragement and positive 
feedback, but rarely tells youth what moves to make. 
Instead, he encourages players to learn from their mis- 
takes and the mistakes of their opponents. In fact, in 
the chess club, there are no “mistakes,” only opportuni- 
ties to learn’ During one practice session, after a stu- 
dent lost a game, the teacher gathered the others 
around the chessboard to discuss the move that con- 
tributed to the loss and asked the group to think of a 
move that would be better — thus turning losing into a 
valuable lesson from which everyone, could benefit. The 
weekly competitions with other schools are similarly 
used as learning experiences. 

• Creates a supportive environment Chess is a competi- 
tive game, but the teacher takes pains to instill a love of 
the game and a spirit of teamwork rather than a com- 
petitive ethos. He sets a positive example by being 
polite and respectful to the youth and, similarly,; discour- 
ages them from making : negative comments about each 
other. When, in one session, one youth criticized . 
another’s move, the teacher quickly responded; “We 
don’t do that [criticize others]. Everyone makes moves 
like that.” Youth pick upon this and treat each other 
with respect. 
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ideas, the group settled on an “Enchanted Forest” as 
the theme for their clay art. Each participant decided 
what figure, related to this theme, he or she would 
create from clay. After the instructor provided the 
group with some guidelines about working with clay, 
she encouraged additional problem solving and deci- 
sion-making by asking them to think through the 
technical challenges presented by their individual 
pieces, such as how to get their figures to stand or 
how to prevent a figure’s horns from breaking. 

As with decision-making, only a few activities provided 
leadership opportunities for youth. These occurred in 
only seven of the activities; and when they did, in 
most instances, were informal and involved youth 
teaching or demonstrating a technique to their peers. 
Sometimes staff asked one youth to help another; 
more often, youth did this themselves without being 
asked. Activities that encouraged youth to collaborate 
provided informal leadership opportunities more 
often. Allowing youth to work together appears to 
encourage youth with “natural” leadership tendencies 
to spontaneously help or teach their peers. (See the 
boxed description of Lego Robotics for an example.) 

One of the few activities that intentionally provided 
significant leadership opportunities was a service 
activity that took place in a k-8 school, where eighth 
graders were being trained to work as assistants or 
junior staff in the after-school programming for first 
to fifth graders. The eighth graders were given real 
responsibility for the younger children — for example, 
helping the children with tasks in their after-school 
activities and accompanying them from place to place 
within the school. 

Perhaps not surprisingly, we found a negative rela- 
tionship between the amount of instrumental support 
provided by the adult and leadership opportunities 
for youth, suggesting that leadership roles are more 
likely to emerge when the staff hold back a bit and/ 
or call on youth to provide instructional assistance. 

On the whole, youth participated actively in the 
sessions and appeared interested and engaged. 

Overall, youth appeared to be highly engaged in 
the after-school activities. Of the 30 activities we ob- 
served, 27 received positive or very positive ratings 



in this area. During these activities, youth actively 
participated, seemed interested in completing the 
project or other work connected with the activity, 
and were focused and attentive most of the time. 

Sessions in which youth were easily distracted or 
complained of being bored were rare, but were more 
often observed in the remedial academic and com- 
munity service activities. For the remedial academic 
activities, the most obvious reason why youth 
appeared less engaged may be that in most cases, 
they chose activities of interest to them; but in the 
case of homework help and tutoring, they were less 
likely to choose out of interest and, in fact, may have 
been struggling with the subject matter being taught. 

Among the different types of activities, it seemed 
most difficult for sites to design and implement serv- 
ice projects that were challenging and engaging. 
While we observed only four service activities, three 
of them were relatively unchallenging and did not 
seem to hold youth’s interest. In one, for example, 
youth volunteered at an animal shelter, but because 
the rules of the shelter were so restrictive (for obvi- 
ous safety reasons), they did little else than play with 
the animals and walk the dogs. In another service 
activity, youth visited residents in a home for the eld- 
erly, where they helped make greeting cards, passed 
out refreshments and led the residents to dinner. 
Neither of the projects seemed to take advantage of 
the learning possibilities that were inherent in the 
service activities; and youth were generally less 
engaged than they were during other types of activi- 
ties, particularly the enrichment classes. 

Specific practices seem to be associated with high 
levels of youth engagement. Youth are most engaged 
when they are participating in activities where the 
social environment of the room is positive (when 
adult-youth and peer relationships are warm and 
friendly) and the adult actively tries to motivate and 
challenge youth. Adults who provided this motiva- ■ 
tion were able to explain the relevance and impor- 
tance of the activity or the skills they were 
developing, challenge youth to push beyond their 
comfort level, encourage them to persevere and 
praise their accomplishments. 

Interestingly, youth engagement was not correlated 
with youth decision-making, suggesting that the 
interpersonal and skill-building dimensions of an 
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What Works? 

Lego Robotics: Youth Working Together to Solve Problems and Make Decisions 



What it is: The aim of this activity is to use Legos, laptop 
computers and other electronic materials to construct 
robots and program the robots to perform various tasks. 
Participants, who are middle-school youth, work in teams 
of three or four to construct their robots. Activity leaders 
are teachers in the school. 

Why it is being highlighted: Lego Robotics is a good 
example of a successful youth-driven, collaborative activity 
that provides opportunities for peer cooperation, decision- 
making and leadership. Among the activities observed, 
these were the aspects of positive youth development that 
were least often present. When they did appear, it was 
generally in project- based, group activities where the adult 
leaders gave youth flexibility in deciding what their finished 
product would be and how they would get there. Such 
activities are often difficult to implement— they require both 
creativity and highly developed group facilitation skills on 
the part of adults. 



How it works: The activity encourages experimentation 
and creative problem solving. Staff provide general guide- 
lines, but it is the youth who are responsible for making 
most of the decisions about their project.. Each team has 
to implement its own design ideas— deciding what sort of 
robot to build and what tasks to try to program into the 
robot. Youth on each team also determine how to organize . 
their work and divide responsibility for building and pro- 
gramming the robot.; 



Why it works: The open-ended, youth-driven, small-group 
structure of the activity fosters high levels of collaboration, 
creative problem solving and decision-making. Staff: 

• Act as a resource to the youth rather than direct their 
work or instruct them. They provide assistance, over- 
seeing each team’s work and supplying help and infor- 
mation as needed. But they also step back to let the 
youth make substantive decisions. 

• Emphasize peer-based learning. The team- based struc- 
ture of the activity promotes cooperative work skills. But 
even when youth work separately to develop particular 
skills, their individual efforts bear on each other because 
each youth eventually brings this knowledge to his or 
her team. In addition, staff actively encourage youth to 
turn to their peers, rather than the adult, for help in solv- 
ing technical questions or other problems. This empha- 
sis on peer-based learning creates a supportive peer 
culture. 

• Promote formal and informal leadership opportunities. 
The assignment of specific responsibilities within the 
teams allows youth: to take turns being the expert on an 
issue that the whole group needs information about: In 
addition, one. youth sometimes emerges as the team 
leader, making decisions and delegating responsibilities 
to other group members. 



= At the beginning of each afternoon’s session, staff set out 
the goal for the day, but then allow each team to decide on 
• its own approach to the work. In one early session, for: :? 
example,: staff explained that the day’s goal was to explore 
and play with the new. materials (such as the Leg os), and 
begin ; experimenting with robot construction. Some youth 
decided to look through catalogs for ideas they could later . :- f< 
use in the semester; some began to;: put robot parts ' | \ 

together; and others started to play with the different * 4 

materials to determine their usefulness. This emphasis on* I 
experimentation allowed: for a: range of approaches and 
resulted, in each team developing different, but equally 
I effective, techniques. 



The youth-driven nature of the activity, coupled with its; 
technical challenges, makes it highly motivating and 
engaging to participants— and an excellent vehicle for . 
expanding their social and problem-solving -skills. Youth 
focus on their work with little direction from: staff; They : 
appear motivated to complete their robots, and they seem 4 
to enjoy the challenge of being responsible for organizing? ? 
itheir work. . . ’? v: X X'c'IS J .? I\' 5 -7 ; ^ ? 
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activity may be more important to middle-school-age 
youth than their degree of input into the activity. 
Thus, while they may be engaged in activities they 
help shape, they can also be engaged in activities in 
which they have had litde say, providing that the 
activities take place in a motivating and supportive 
interpersonal environment. 

Overall, the enrichment activities were fullest in 
developmental supports and opportunities. 

As a whole, the enrichment activities provided youth 
with the richest environment for positive develop- 
ment. The average ratings for adult-youth relation- 
ships, cooperative peer interaction and decision- 
making were all higher for this type of activity. In 
addition, project-based activities like Lego Robotics 
fostered spontaneous informal leadership. A number 
of the activities, like Lego Robotics and Chess Club, 
also incorporated academic skills such as math and 
problem solving. 

Creative arts activities scored as high on youth 
engagement as did the enrichment activities and were 
individually strong in their provision of developmen- 
tal opportunities. Creative activities that appeared to 
be particularly effective included an acting class that 
provided the opportunity for youth to write their 
own improvisations and plays, and a drawing class 
where the instructor helped youth develop their 
drawing skills while relating the techniques they 
were learning to the work of famous artists. 

Remedial academic activities generally offered 
fewer kinds of developmental supports and 
opportunities. 

These activities (homework help and tutoring) pro- 
vided fewer opportunities for peer interaction and 
decision-making than did other types of activities, 
and they also rated relatively low in youth engage- 
ment. But they achieved their purpose. Staff leading 
the activities seemed skilled at providing youth with 
the support they needed to complete tasks success- 
fully. More important, youth who participated in 
these activities reported that the sessions really 
helped them catch up on their learning and com- 
plete their homework. Most of these youth were 
struggling in school, and the sessions provided a use- 
ful service. As one student said: 



I think it's helpful ' 'cause you can have teachers 
that like know what they re doing, that gave you 
the work, or you can ask students that understand 
the work that you have, that could help you easier 
than if you were at home . 

Another pointed out that the teacher always checked 
at the after-school session to be sure he had com- 
pleted his homework u so you won’t like get away and 
don’t do it.” 

The smaller class size of the after-school sessions was 
also important to students. As a youth in a middle- 
school math club noted: 

Like the different things you don } t know about 
math, you learn it.. .1 mean, 'cause it's too many 
people in one room [in the school-day math class], 
and [the teacher] can't pay attention to each one. 

(See the boxed description of this math club.) 

Even for youth who are doing well in school, home- 
work activities can be a useful experience. As one girl 
who is a successful student reported, she attended 
because she liked to get her homework out of the 
way and also because she was given the opportunity 
to help other youth, an experience she valued. 

What are the Implications of these 
Findings for Policy and Practice? 

As the discussion above suggests, there was some vari- 
ation in the kinds of supports and opportunities pro- 
vided to youth across the different categories of 
activities. At the same time, there was also variation 
in quality among activities within each category. 
These variations suggest some key lessons for policy- 
makers and practitioners as they attempt to develop 
and implement high-quality, after-school programs: 

• Any type of activity can be rich in developmental 
opportunities , depending on how it is delivered . 

It was not the topic or skill that was being ad- 
dressed, but the abilities of the staff member 
leading the session that were the key to high- 
quality activities. While youth came to the activi- 
ties with some initial interest in them, that 
interest was most likely to be heightened and 
sustained when specific practices were in place. 



The Quality of Activities Offered in the Programs 
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What Works? 

Math Club: Youth Development Principles Enhancing Remedial Academic Activities 



What it is: Taught by the school’s sixth-grade math 
teacher, the after-school club helps students who are 
struggling in her class to master the math taught during 
the school day. The after-school sessions are offered three 
days a week. Class size is limited to 10 to 12 youth; and, 
to accommodate as many students as possible in this 
small group setting, students are allowed to attend only 
one session a week. 

Why it is being highlighted: Among the academic activi- 
ties in the after-school programs, the math club stands out 
because it demonstrates how positive youth development 
practices can be incorporated into a remedial academic 
activity. 

How it works: The teacher’s goals are to improve the 
youth’s understanding of math and build their confidence 
in their math ability. Her approach to remediation goes 
beyond simply reviewing the week’s work or providing 
extra practice; Instead of relying on pencil and paper math 
problems, she uses a variety of approaches — including 
math games, puzzles and other hands-on activities-— to 
demonstrate and reinforce math concepts. This allows stu- 
dents to explore what they have been learning during the: 
school day in more detail and apply the concepts in a vari- 
ety of ways, leading to a deeper understanding. In addic- 
tion, the variety of the activities helps keep the youth 
focused and engaged. - • v- 
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Why it works: Because it is taught by the youth’s class- 
room teacher, the activity has a direct connection to the 
school day, and the youth can see its impact immediately. 
But the real key is the quality of the adult-youth interac- 
tions. The teacher communicates her warmth and concern 
for youth’s academic success through ongoing encour- 
agement and the praise she gives when they succeed, 
praise designed to change their negative views of their 
math ability. She: 

• Challenges and supports the youth. She boosts their 
math self-confidence by structuring the tasks and 
instructional pace so youth are successful. As she 
moves them through each activity, she makes sure they 
can succeed at the tasks, then challenges them to try 
something a bit more difficult. During one session, for 
example, when she saw that the youth at one worksta- 
tion were proceeding without difficulty, she encouraged 
them to try something more challenging at the com- 
puter on which they. were working. When they suc- 
ceeded, she said, “See how smart you are.” 

• Is, in the words of one observer, “a master at giving 
clear explanations. " She takes care to make sure every 
student grasps the concepts she is covering. “Are youi 
sure you understand?” she asks. “All of you?" And after 
presenting each afternoon’s instructions, she walks: ’ 
around the classroom to check on individual students 
and help those who need it. 

• Takes advantage of the small size of the after-school 
group. The math club provides opportunities for: her to % 
get to know her students better and to be particularly . ,4 
attentive to their individual learning -styles. She is also 
able to have more personal exchanges than might be 
possible during the day. These exchanges can help her 

inform a closer bond with the students, understand their 4 
^heeds: and teach more effectively during the school day. 

In one case; for example, after praising a student:.fo^^. 
4: s uccessf u ijy complet in g : h is math work th at aftern o o n : ,4 
\ she asked him, “What can I do to help you during 

4 * class? Are others distracting you?^ : -j v .,v.. • c ' : -l Y 

* < " ''S'*' In her responsiveness to the youth, and her ability to chal- ' 

7 Y lenge and support them and build their confidence inThem *4 

math skills!;the teacher of the math club blends: important; 4 
youth development principles and effective teaching-learn- 
ing strategies into a successful remediakmath [activity. 7 : 7 
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These included a positive social environment, 
where both adult-youth and peer relationships 
were warm, friendly and supportive, but chal- 
lenged intellectual environment where the 
adult actively motivated youth, pushed them to 
achieve beyond their (the youth’s) initial expec- 
tations, encouraged them to persevere and 
praised their accomplishments. It did not seem 
to matter whether the adult was a youth worker 
from a CBO or a teacher from the school. 
Teachers could be as warm and responsive to 
youth as were experienced staff from CBOs, 
and the latter were just as successful in instruct- 
ing youth as were the teachers. 

• Different kinds of activities provide opportunities for 
youth to develop in different areas. Academic activ- 
ities like homework help and tutoring are a 
“given” in school-based, after-school programs 
and, when done well, they provide youth with 
strong adult support that is valuable even 
beyond the activities’ immediate purpose of 
building academic skills. Among the ESS pro- 
grams, however, die enrichment activities pro- 
vided youth with the richest environment for 
positive development. In addition to fostering 
strong adult-youth relationships, they provided 
opportunities for cooperative peer interaction 
and collaborative learning and for youth to 
develop decision-making and leadership skills. 

A number of these activities also incorporated 
academic skills such as writing, math and prob- 
lem solving. 

The following chapter discusses the ways in which 
participation in the ESS after-school activities 
benefited youth. 
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V. Benefits to Participants After-school programs attract youth by offering them 

fun and interesting activities. Once there, the relation- 
ships they form with program staff and their peers 
(along with their innate interest in the activities) keep 
them coming. Program staff can then create an envi- 
ronment that stretches youth — heightening or 
expanding their interest and helping them master 
new tasks or skills . 24 One writer theorizes that, through 
repeated opportunities to experience “the sparks of 
excitement and absorption” in everyday life, youth 
develop initiative — the ability to motivate themselves 
from within and direct effort toward a goal . 25 

Good after-school activities can offer these absorbing 
experiences that help youth develop initiative. In 
addition, learning new things or improving a skill 
can give youth a sense of achievement and compe- 
tence that, in turn, improves their sense of self. 
Improving youth’s willingness to be persistent in the 
after-school setting could theoretically also spill over 
to the academic environment — perhaps even if the 
after-school activities are not academically focused. 

Beyond those potential benefits, after-school pro- 
grams can fill important social deficits experienced 
by some youth. In these settings, youth receive posi- 
tive adult and peer attention that can reduce their 
need to use negative behaviors in order get attention 
from parents, teachers and peers. The tone set by 
staff members can also teach youth to socialize in 
more appropriate or mature ways. In addition, prior 
research has shown that forming positive attach- 
ments to, and obtaining guidance from, responsible 
adults can reduce the tendency of some youth to 
engage in risk-taking behaviors. 20 ’ 

Because they are school-based, the ESS programs 
may have some additional, school-related outcomes. 
Participating in a fun program at school may lead 
youth to come to school more often, like school 
more and/or increase their sense of belonging in the 
school community. These positive school-related atti- 
tudes and behaviors are hypothesized to further 
increase the probability that youth’s academic per- 
formance would be enhanced. 

Because the ESS programs are relatively young, it is 
now possible only to get an early sense as to whether 
the services the programs provide to youth are likely 
to positively affect them. A rigorous investigation of 
their impacts using a comparison group will be 
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appropriate only after programs are more established 
and have had time to fine tune their operations. Thus, 
in this chapter we report on our initial indications. 

The chapter addresses the following questions: 

• To what extent did the after-school programs 
change the way youth used their after-school 
time? 

• What were the potential behavioral, academic 
and personal benefits for youth? 

• What were the benefits for the youth’s parents? 

• What are the implications of these findings for 
policy and practice? 

We investigated the potential benefits using two dif- 
ferent strategies. In surveys administered in Spring 
2001, we asked youth about the ways they felt ESS 
had helped them, and we also asked parents about 
the ways they felt the programs had helped their chil- 
dren. In addition, for some outcomes, we examined 
ESS’s possible effects by comparing changes in the 
attitudes and behaviors of youth who participated in 
the after-school program and those who did not par- 
ticipate. It is important to note that the relationships 
between participation in ESS and the degree of 
change in youth indicate only that there is an associa- 
tion between the two; they do not indicate cause and 
effect. (See Appendix B for a fuller discussion of the 
method o log)'.) 

Did the Programs Change the Way 
Youth Used Their After-Schooi Time? 

One important question about after-school programs 
is whether they increase youth’s productive use of 
their after-school hours. After all, when the ESS pro- 
grams opened, youth and parents could have just 
substituted those programs for other activities, such 
as clubs and sports teams, in which the youth were 
already participating. 

As discussed in the chapter on participation, ESS 
tended to attract youth who were already “doers.” 
During the year before they enrolled in ESS, approx- 
imately 70 percent of them had gone to some organ- 
ized after-school activities — 18 percent went to 
something once a week; 24 percent, two or three 
times a week; and 28 percent, four or five times a 
week. However, almost 30 percent had participated 
in no organized activities during the previous year. 



The youth who had previously been the most 
involved in organized activities — those who partici- 
pated two to five days a week before enrolling in 
ESS — primarily substituted ESS for their other activi- 
ties. However, for the 48 percent of ESS participants 
who had previously taken part in organized activities 
either one or no days a week, ESS represented a sub- 
stantial increase in their productive use of time dur- 
ing the after-school hours. Youth who had previously 
participated in no organized activities were enrolled 
in ESS an average of 2.2 days a week; and youth with 
one day of previous activities were enrolled in ESS an 
average of 1.8 days a week. Both of those groups also 
reported attending more than a day a week of other 
after-school activities. 

What Were the Apparent Benefits for 
Youth? 

Students who participated in the school-based, after- 
school programs seemed to experience positive 
change in four key areas: staying out of trouble; 
improving their school attitudes and behavior; 
strengthening their social networks; and learning 
new skills, seeing new possibilities and improving 
their self-confidence. 

Staying Out of Trouble 

One particularly important outcome desired for 
after-school programs is that they decrease the risk- 
taking behavior of youth. By proriding them with 
structured, supervised activities, the time they have 
to get into trouble is decreased. In addition, the 
social rules and tone implemented by staff can teach 
youth to deal more appropriately with negotiation, 
social conflict and anger. 

When we asked parents and youth if ESS helped 
them stay out of trouble and more appropriately deal 
with conflict, both groups — but especially the par- 
ents — believed ESS was very useful in this regard (see 
Table 5). 

In addition to asking parents and youth about these 
behavioral characteristics, we measured changes in 
the youth’s behavior over time. In 1999-2000, when 
they first entered the ESS program, youth answered a 
detailed survey about their beliefs, attitudes and 
behaviors. An average of 13 months later, in Spring 
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Table 5: 

Youth and Parent Reports: Staying Out of Trouble 



Youth Report: 

ESS... 

helps me stay out of trouble 65% 

helps me learn how to say no to things that 
I know are wrong 

or that make me uncomfortable 62% 

helps me deal calmly with people 
who are being mean or starting fights 48% 

Parent Report: 

ESS... 

helps my child stay out of trouble 84% 

helps my child settle arguments 
without fighting 72% 



Tablfe6; ■ , 

The Relationship Between ESS and 
Staying Out of Trouble' 

Per Week of E 




Percent indicating they 
handle anger in socially 

appropriate manners 53 73 +20 

Percent reporting they 

started drinking alcohol 16 9 -7 



*8ased on statistical analysis of the oaseime and follow-up surveys. 



2001, they were asked these same questions again. 
Changes in youth’s responses from the initial to the 
follow-up survey suggest that youth who attended 
ESS were more likely to react in a more socially 
appropriate manner to social challenge and were less 
likely to have begun to drink alcohol. 

This change is illustrated in Table 6, which considers 
two theoretical groups of youth. Youth in the two 
groups are similar, and their responses to quesdons 
about behaviors and attitudes on the initial, pre-ESS 
survey, in 1999-2000, were identical. One group then 
attended ESS two days a week, die approximate aver- 
age number of days that youth participated across 
the 10 intensive research sites. The other group did 
not go to ESS. 

On the second survey, administered 13 months later, 
73 percent of the youth who went to ESS indicated 
that they handled their anger in socially appropriate 
ways, through their responses to questions about 
whether they hit or yelled when they were angry, 
tried to talk things out with the person with whom 
they were angry or talked to an adult about the prob- 
lem. Among similar youth who did not go to ESS 
during die research period, 53 percent indicated 
they handled their anger in socially appropriate ways. 
In addition, 9 percent of these ESS participants 
reported they had started drinking alcohol over the 
research period, as opposed to 16 percent of similar 
youth who did not go to ESS. 27 



School Attitudes and Behaviors 

Most program operators, teachers and funders 
believe that youth’s participadon in after-school activ- 
ities, such as those offered by the ESS programs, can 
positively affect academic attitudes and efforts and, 
ultimately, performance. Despite these assumptions 
and hopes, however, the links between youth devel- 
opment activities and academic outcomes are not 
fully understood. Teachers, principals and program 
staff have repeatedly told us that an important bene- 
fit of after-school programming is that it makes the 
youth more ready to learn (to sit still, pay attenuon 
and try harder) when they are in school. Many also 
expect that the help youth get on homework will also 
lead to better performance in school. 

Data are just emerging about how after-school pro- 
gramming affects academics. Most of the after-school 
programs that have been shown to have an impact 
on academics are those that mandate five-day-a-week 
attendance. And even then, grades have been slow to 
change. In one study, for example, die audiors found 
that youth in after-school programs did begin to 
attend school more often but, at first, there was no 
impact on grades. 28 

Given that most of the ESS programs were new and 
the levels of participation were well below five days a 
week, it was not thought likely that we would observe 
changes in grades or test scores. However, to gauge 
whether ESS was starting to have positive academic 
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Table 
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Youth Report: 

ESS... 



helps me do better in school 65% 

helps me like school more 50% 

helps me learn that hard work pays off 71 % 



Parent Report: 

ESS... 

helps my child do better in school 79% 

helps my child like school more 86% 

helps my child try harder in school 82% 

helps my child complete homework 71 % 



Table 8: 

The Relationship Between ESS and School Attitudes 
and Behaviors* 

HT" 



| Days Per Week of ESS 
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Percent reporting they 

started skipping school 20 11 -9 

Percent reporting they 

really paid attention in class 29 49 +20 

Percent reporting they 
felt very proud to belong 

to their school 76 84 +8 



* Based on statistical analysis of the baseline and fcllcw-up 
surveys 



effects, we asked parents and youth if they thought 
the program helped the youth do better in school. In 
addition, we measured some “leading indicators” of 
academic improvement (a sense of academic mastery 
and the level of school effort) to ensure that we did 
not miss an important change if one had occurred. 

As Table 7 illustrates, approximately two-thirds of the 
youth believed the program helped them do better 
in school, and it was even more likely that the par- 
ents found the program helpful to their children in 
this way. However, only half of the youth reported 
that they liked school better because of the program. 
As one of the parents in our interview study sug- 
gested, the youth may like going to school because 
that allowed them to go to ESS after the traditional 
school day, but they did not necessary like the school 
day better. The youth did, however, feel that ESS 
helped them understand that hard work can pay off. 

Interestingly, the parents' survey responses are con- 
sistent with the expected pathway of change that 
could ultimately lead to increased academic success. 
High percentages of parents felt that ESS helped 
their children like school more and try harder in 
school, factors that may lead to learning more and 
doing better. 

When we examined how the youth's academic atti- 
tudes and behaviors changed over time, we found a 
consistent story. Youth who participated in ESS activi- 
ties experienced a greater increase in their sense of 
belonging at school and paid more attention in class. 



Again, consider the two groups of similar youth. As 
Table 8 illustrates, among the youth who did not go 
to ESS during the 13 months between the initial and 
follow-up surveys, 20 out of 100 reported that they 
started skipping school, 29 said they really paid atten- 
tion in class, and 76 said they were very proud to 
belong to their school. Among similar youth who 
went to ESS two days a week, only 11 out of 100 
reported starting to skip school; 49 said they really 
paid attention in class; and 84 said they were very 
proud to belong to their school. 

Social Benefits 

With schools squeezing in as much learning as possi- 
ble during the day, times that have traditionally been 
available to students for socializing, such as lunch 
and recess, have been shortened or eliminated, leav- 
ing youth with fewer opportunities to socially interact 
with one another. And yet, during the late elemen- 
tary school and middle school years, learning to 
appropriately interact with peers is a pressing devel- 
opmental task. 

After-school activities offer youth time to be with a 
wide range of their peers. By providing them with 
opportunities for these social interactions, the pro- 
grams offer youth a chance to improve their social 
competence and get to know, and get along with, a 
more diverse group of peers. For some youth who 
are socially isolated, perhaps because they are new to 
the school or because other factors have made it dif- 
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Youth and Parent Reports: Social Benefits 




Youth Report: 
ESS... 


73% 


helps me make friends 


helps me be less shy around kids 


63% 


helps me learn about other 
cultures 


52% 

5 


Parent Report: 

ESS... 


92% 


helps my child make new friends 
helps my child get along better 


86% 


with other children 






ficult for them to regularly interact with peers, partic- 
ipation in the after-school programs may lead to 
their feeling less socially isolated. 

Indeed, as Table 9 illustrates, a benefit of ESS that 
was commonly cited by both youth and parents is 
that the program helps the youth make friends and 
get along better with their peers. In addition, 61 per- 
cent of the participants said that being in ESS helped 
them feel “less shy around adults,” suggesting that 
their experiences in the program are helping them 
more easily interact with adults. 

Skills, Self-Confidence and Life’s Possibilities 



more than 9 out of 10 parents felt their child learned 
new skills and expanded their interests. Both parents 
and youth overwhelming felt that ESS helped the 
youth feel better about himself or herself. 



What Were the Benefits to Parents of 
their Children’s Participation in ESS? 

In addition to directly benefiting youth, we expected 
that participation in the after-school activities could 
positively influence the quality of the parent-child 
relationship through a number of routes. First, it has 
the potential of decreasing parental stress by provid- 
ing after-school care — a benefit that would be of par- 
ticular importance to the large majority of the 
parents who were employed (69% had full-time jobs 
and 12% held part-time jobs) . The after-school activi- 
ties could also eliminate a major source of parent- 
child tension by providing opportunities for students 
to complete their homework before going home 
after school and, in addition, could supply youth 
with support from other adults so they are less 
demanding of parental attention. 

In addition, research on mentoring has found that 
close connections with non-parent adults can foster 
improvements in youth's ability to connect with oth- 
ers. 29 Through consistendy warm and accepting inter- 
actions with program staff, youth can begin to 
recognize the potential that exists in close relation- 
ships and open themselves up more to the people 
around them, particularly their parents. 



The final set of outcomes we examined included 
learning new skills, seeing new possibilities in life 
and gaining self-confidence. Both parents and youth 
frequently cited these benefits (see Table 10). In fact, 



Responses on the parent survey administered in 
Spring 2001 suggest that the after-school programs 
were having some of these beneficial outcomes: 



Table 10: . XJ- 4 S# 

Youth and Parent: Reports: Skills,: Possibilities and Self-Confidence 



Youth Report: 

I see that t have choices and possibilities in life that I didn’t know I had 
The after-school program helps me do things I didn’t think I could do 
It helps me feel good about myself 
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74% 

72% 

69% 



Parent Report: 

The after-school program helps my child learn new skills or develop new interests 
The after-school program helps my child feel more self-confident 
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• 80 percent of parents said they were less wor- 
ried about their child’s safety after school.' 

• 57 percent said their child’s participation 
helped them manage their own work schedule. 

• 47 percent said it let them attend classes or job 
training more easily. 

• 45 percent said it helped them get a better job 
or do better at their job. 

In addition, 86 percent of parents said the program 
was helping them to more appreciate their child’s 
talents, and 74 percent said the program helped 
their child get along with family members. 

What are the Implications of these 
Findings for Policy and Practice? 

In this chapter, we examined the relationship 
between participation in school-based, after-school 
programs and a range of academic, behavioral, social 
and attitudinal outcomes. Like other studies, we 
asked parents and youth what effects they believed 
accrued from participating in the ESS programs. To 
complement the opinion data we obtained from par- 
ents and youth, we also examined, for some out- 
comes, how youth’s attitudes and behaviors changed 
from the time they first started their ESS participa- 
tion (between Fall 1999 and December 2000, until 
Spring 2001). We developed a comparison between 
youth who went to ESS an average of twice a week 
and youth who did not attend the after-school pro- 
gram at all. Our findings suggest these lessons for 
policymakers and practitioners: 

• Participation in school-based , after-school programs 
is associated with behavior that could help youth 
stay out of trouble. One key goal of after-school 
programs is to provide youth with productive 
ways to use their out-of-school time and, thus, 
reduce their opportunities for risk-taking behav- 
ior. Our findings are consistent with ESS having 
this effect. Youth who attended the after-school 
programs reported less often that they had - 
started drinking alcohol, and more often indi- 
cated that they handled their anger in socially 
appropriate ways. In addition, in the survey of 
parents, more than 80 percent agreed that 
“helping my child stay out of trouble” was a 
major benefit of ESS. 



• Participation in the after-school programs is associ- 
ated urith positive effects on school attitudes and 
behaviors, but it is too early to know whether it has 
an impact on students’ grades and test scores. A sec- 
ond important goal of after-school programs is 
improved academic outcomes for youth. 

Because most of the ESS programs were new 
and students participated, on average, fewer 
than two days a week, we did not expect to find 
changes in grades and, thus, instead examined 
indicators of academic improvement, such as 
youth’s sense of competence in school and their 
level of effort. We found that youth who 
attended ESS reported more often that they 
really paid attention in class and were very 
proud to belong to their school, and they less 
often reported that they had started skipping 
school during the period between the baseline 
and follow-up surveys. In addition, in their own 
survey responses, more than 80 percent of par- 
ents agreed that participation in ESS “helps my 
child try harder in school,” and 70 percent of 
the youth similarly agreed that their participa- 
tion in the after-school program “helps me 
learn that hard work pays off.” 

As earlier studies have also found, 30 participants and 
their parents reported other social, academic and 
personal benefits. Between 80 and 90 percent of par- 
ents agreed that the after-school programs helped 
their child make new friends, learn new skills and 
increase their self-confidence. Although youth cited 
fewer benefits than their parents, approximately 70 
percent of them agreed that participation in ESS 
helped them make friends, see new life choices and 
feel better about themselves. 
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VI. The Cost and Funding of 
After-Schooi Programs 



In contemplating new after-school initiatives, policy- 
makers naturally ask, “How much does it cost to run 
one of these programs?” This deceptively simple 
question can have many answers, depending on what 
is included or excluded when defining “cost.” 

This chapter attempts to provide full and useful 
answers to the question by costing out 10 after-school 
programs using the same criteria and including the 
same cost components, regardless of whether pro- 
grams paid in cash or received contributions. 31 
Because of this equal treatment, it is possible to esti- 
mate the average cost of an after-school program, 
examine the different cost components and look at 
the factors that drive the costs. The discussion 
focuses on programs that are running four or five 
days a week, and it does not include planning and 
start-up costs. In addition, it is important to note that 
the cost study did not examine the relationship 
between costs and benefits to youth who participated 
in ESS at these schools. 

The chapter examines the following questions: 

• What is the approximate cost of a typical after- 
school program? What is the approximate daily 
cost for each youth slot? 

• What are the major cost components? Which of 
those costs will most likely be paid through the 
cash budget? Which could most likely be cov- 
ered through redirected contributions from 
partner agencies? 

• What factors drive costs? 

• What are the major funding sources and what 
strategies are sites using to become sustainable? 

• What are the implications of these findings for 
policy and practice? 

Answers to these questions can provide a framework 
for policymakers and program planners as they assem- 
ble the building blocks to finance new after-school 
programs or re-evaluate the funding of existing ones. 
While the data are drawn from 10 ESS sites, the 
method of estimating costs should be applicable to 
most in-school, after-school programs. It can also be 
adapted for after-school programs in other settings, 
where some of the factors driving costs may vary. 32 
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What Does lit Cost to Run an After- 
School Program 

Ten geographically dispersed after-school programs 
of different types cost an average of approximately 
$150,000 during the school year. The typical pro- 
gram provided youth services from September to 
June for five days a week during the two or three 
hours after the school day ended and served 63 
youth per day. 

As Table 11 illustrates, across the 10 sites, the total 
cost of an after-school program during the school 
year ranged from a low of $63,118 to a high of 
$265,742. The range in costs is not simply a reflec- 
tion of the number of youth served. A useful budget- 
ing tool in planning after-school programs is a unit 
cost measure. Ideally, after-school programs plan 
youth activities, snacks and transportation for the 
number of youth who actually attend rather than the 
number of youth who are scheduled to attend. 
Therefore, this study estimated the cost per day of 
one youth slot when the programs were fully opera- 
tional. 33 Among the 10 programs, the average unit 
cost per day for a youth slot was $15. However, as we 
will later discuss, the unit cost varied from a low of $8 
to a high of $36 across the 10 programs.^ 

The following section looks at the various compo- 
nents — the building blocks of after-school program 
budgets — that contribute to these costs. 



Cost Profile of 1 0 After-School Programs 

Average Range 



Total cost 


$149,620 


$63,1 18-$265, 742 


Number of weeks 


33 


30-36 


Number of days 


per week 


4.7 


3-5 


Number of youth 


served daily 


63 


25-88 


Total cost per day of 


one youth slot 


$15 


$8-$36 
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What Were the Largest Cost 
Components? 

Figure 2 illustrates the average distribution of cost 
components across the 10 ESS programs. Although 
the programs adapted different models and served 
different age groups, some clear budgeting patterns 
emerged. Across the sites, the largest cost compo- 
nent was the administration of programs, which rep- 
resented 54 percent of total costs. Although, at first 
glance, it might appear that the after-school pro- 
grams were top heavy with administration, this is not 
necessarily the case. A later section examines what 
drove those costs, which include professional salaries 
and the time and expertise contributed by top-level 
administrators who helped build the programs’ infra- 
structure. 

As one might expect, the cost of providing youth 
activities — hiring adults to lead the after-school activi- 
ties and providing the equipment and materials — is 
one of the most expensive items (on average, 35% of 
total cost). At the same time, the cost of the remain- 
ing services was a smaller part of total costs than pro- 
gram planners might have initially thought. The total 
cost of providing transportation, snacks and custodial 
help — all essential components of an after-school 
program — accounted for only about II percent of 
programs’ expenses. 

What Was the Davisson Between Cash 
Expenditures and Costs Covered By 
Partner Agencies? 

After-school programs covered their expenses in two 
ways: through cash expenditures and redirected con- 
tributions, which include expenditures covered by 
partner organizations, the value of contributed time, 
and other services, such as bus transportation and 
custodial assistance. 35 

Across the 10 ESS programs, cash budgets covered, 
on average, about 60 percent of the total cost. School 
districts and other partner organizations covered the 
remaining costs with redirected contributions. On 
average, after-school programs’ cash expenditures 
were about $89,000, or approximately $9 of the $15 
cost per day per youth slot. The programs’ additional 
$61,000 of expenses were covered by the redirected 
contributions, or approximately $6 of the cost per 
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day per youth slot. 36 Thus, on average, 40 percent of 
the after-school programs’ costs came from redi- 
rected contributions. However, it is important to note 
that the percentage of costs covered by these contri- 
butions ranged from 5 percent to 58 percent among 
the 10 programs. 

Program costs can be organized into three major cat- 
egories: administration; youth activities; and support 
services, including custodial help, transportation and 
snacks. In general, cash expenditures and redirected 
contributions covered different areas of costs. Cash 
expenditures went primarily for salaries for adminis- 
trators and leaders of youth activities. The combined 
support services of custodial help, transportation and 
snacks accounted for only about 5 percent of the 
cash expenditures. Redirected contributions prima- 
rily covered the costs of additional administrative 
expertise, salaries of youth leaders, custodial help, 
transportation and snacks. Figure 3 illustrates the 
average cash and non-cash expenditure in each of 
these categories. 

Administrative Costs 

Almost all of the administrative cash cost was for 
salaries — programs spent an average of $48,000 on 
this item. As described in Chapter II, a typical after- 
school site had a program director and a site coordi- 
nator. In some cases, there was also one or more 
on-site support staff. Where the program director was 
a full-time job, the annual salary with fringe benefits 
ranged from $34,000 to $60,000. In those cases, the 
director administered from three to six after-school 
programs throughout the city. Where the position 
was a part-time job, the director usually worked 20 
hours a week and was responsible for three or four 
programs. In some cities with only one or two after- 
school programs, an executive-level admin is trator 
from a college or a CBO filled the program direc- 
tor’s role. 

Site coordinator salaries ranged from $5,000 to 
$39,000, depending on the number of hours worked 
and the salary scale for that program. In addition, 
some programs hired support staff, although their 
salaries were a small component of administrative 
costs. Among the 10 programs, support staff ranged 
from a full-time program staff person to minimum- 
wage, part-time assistants to stipended high school- 
age youth workers (often high school students who 
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had previously attended the program), to no support 
staff at all. 

In addition to the costs of paying salaries, the pro- 
grams needed another $8,000 to cover other cash 
expenditures, such as office expenses, staff training 
and public relations. 

The redirected contributions that covered adminis- 
trative costs took the form of contributions of admin- 
istrative time and expertise. After-school programs 
received assistance from administrators in their spon- 
soring community organization, partner community 
organizations, the school districts and colleges. 

The cost of these contributed hours was a significant 
portion of the overall administrative cost, and its 
importance could extend beyond administrative serv- 
ices, such as handling the payroll and doing the 
financial reporting. For example, although program 
directors spent some of their time nurturing partner- 
ships and doing fundraising, another method of 
developing funding was to obtain the services of a 
grant writer, and this was usually a contributed serv- 
ice. Although fundraising increased the cost of pro- 
grams in the short term, the programs often 
succeeded in expanding their funding base and 
securing the sustainability of their activities for the 
next several years. 

Youth Activities 

The major cost associated with the youth activities was 
the salaries of the activity providers, who included 
teachers from the schools, staff from CBOs and other 
adults. The programs spent an average of $28,000 in 
cash expenditures on youth activities, almost all of 
which went to pay hourly wages to the activity leaders. 
Most of the redirected contributions in this area simi- 
larly went to cover the salaries of activity providers 
who were on the staff of partner agencies. 

Support Services 

Although bus transportation, snacks and custodial 
help — all essential components of after-school pro- 
grams — can be expensive items, the majority of sites 
obtained these services by developing strong partner- 
ships with their host schools and school districts. 
School districts covered most or all of the cost of 
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Low 


Average 


High 


Program Administration 


$36,000 


$80,000 


$145,000 


Youth Activities 


$22,000 


$53,000 


$98,000 


Transportation 


$0 


$9,000 


$34,000 


Snacks 


$1,000 


$5,000 


$11,000 


Custodians 


$0 


$3,000 


$11,000 



snacks, buses for transportation home and additional 
custodial hours beyond the usual school requirements. 

On average, after-school programs spent approxi- 
mately $5,000 in cash expenditures on all three 
items. Eight of the 10 programs incurred no cash 
expenditures for custodial help, and half of the pro- 
grams were able to obtain snacks through the 
Department of Agriculture’s nutrition program at 
their schools. Most school districts rearranged bus 
schedules to accommodate the after-school pro- 
grams, so programs often paid only for bus trans- 
portation for field trips. 

What Makes Some Programs Cost More 
(or Less) Than Others? 

The total cost of the 10 after-school programs ranged 
from approximately $63,000 to $266,000. As Table 12 
illustrates, there was a similarly large range across each 
of the component parts of the programs’ budgets. 

And while the average number of youth served daily 
varied widely among the programs — from 25 to 88 — 
the range in costs was not simply a function of num- 
bers of youth served. In fact, the daily cost per youth 
slot ranged from $8 to $36, with an average of $15. 

The cost of individual after-school programs depended 
on a number of factors: program’s choices and oppor- 
tunities; basic requirements of their community setting 
(for example, the need for transportation); and their 
relative ability to plan accurately for the actual number 
of youth who would be participating. In addition, some 
programs had higher costs because they were very suc- 
cessful in forming partnerships and, thus, were able to 
leverage additional resources for youth activities or for 
fundraising and other efforts to develop and sustain 
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their programs. Their higher costs, in other words, 
were a function of having greater resources that 
allowed them to do more. 

Choices and Opportunities 

Programs costs are affected by the choices made 
about administrative structure, the types of activities 
provided and the staff-to-youth ratio, as well as the 
degree of focus on factors such as fundraising and 
the future sustainability of the program. Looking 
across programs at the high or low level of expendi- 
tures for these components, one can ask, “What did 
the program gain?” or “What did the program do 
without?” 

1. Administrative structure. The largest cost com- 
ponent of all 10 after-school programs was 
administration, and the two key staff positions 
whose salaries are included in this cost are the 
program director and the site coordinator. 
While those positions were almost always cov- 
ered through cash expenditures, many of the 
programs were also able to leverage additional 
administrative expertise from partner agencies 
that contributed staff time. 

What appears to matter most in administrative 
costs is that sufficient resources are expended 
on the internal management of die after-school 
program, and on developing and maintaining 
external partnerships and working to create a 
solid base of funding. Ideally, the site coordina- 
tor was a full-time position and the program 
director was budgeted for a sufficient number 
of hours to fulfill the essential role of develop- 
ing partnerships, raising funds and performing 
the numerous odier tasks that are necessary for 
sustaining programs. 

When either the program director’s or site 
coordinator’s role was allocated too few hours 
in the budget or left unfilled for months at a 
time, the after-school programs suffered. 
Problems that surfaced included a drop in 
youth attendance and a lack of system building 
for future sustainability. In addition, while the 
time contributed by partner agencies increased 
total program costs, it also had the positive 
effect of building the infrastructure of the after- 
school programs. 37 



2. Activity leaders’ salaries. A key factor in the cost 
of activity leaders was the extent to which the 
school’s regular teachers were involved in the 
after-school program and how their salaries 
were covered. Some of the after-school pro- 
grams hired non-teacher activity leaders who 
could work at a pay scale that was lower than 
teachers’ union-mandated hourly salaries. In 
some cases, however, programs specifically 
sought the expertise of certified teachers (a 
programmatic choice) even if it meant paying 
higher salaries. In other instances, the teachers’ 
higher hourly salaries were easily covered 
because redirected funds for this purpose were 
available through the school district (an oppor- 
tunity). Finally, in some school districts, teach- 
ers were paid lower hourly salaries for work in 
the after-school programs than they received 
during the regular school day. 

In addition, decisions to hire other staff for the 
after-school programs, beyond the regular activ- 
ity leaders, also increased costs. One program, 
for example, had a physical education teacher 
as a part-time member of the after-school staff. 
Another program had the part-time, con- 
tributed services of a police officer from a com- 
munity relations department. 

3. Serving more youth for fewer days. To meet the 
needs of their particular communities, planners 
at some of the sites chose to have their after- 
school programs serve a large number of youth 
less intensively — each youth attended for fewer 
days per week. Sites that made this decision 
incurred higher administrative costs because 
they had to handle the transportation and 
other logistics of having a different group of 
youth scheduled for each day. 

4. Breadth and types of youth activities. Some pro- 
grams offered activities, particularly perform- 
ance and visual arts activities, that were more 
costly to run but enriched the program. 
Typically, they were able to do this because of 
their success in forming partnerships and lever- 
aging resources. One site, for example, offered 
an art activity — funded through redirected con- 
tributions from a partner organization — that 
was led by working artists who were paid a rela- 
tively high hourly rate. 
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5. Staff-to-youth ratio. Some after-school programs 
had higher costs because of decisions to provide 
mentoring or one-on-one tutoring, or to simply 
have more staff available to interact with youth. 
In some cases, programs hired high school 
youth or college students to supplement their 
staff. One program benefited from the con- 
tributed services (calculated as part of the total 
cost) of graduate students on assistantships who 
mentored and tutored individual youth. When 
programs hired high school youth, the added 
expense was minimal because they received 
minimum wage salaries or stipends. Those 
youth, who had formerly attended the after- 
school program as middle-school students, 
could serve as role models for participants, as 
well as improving the staff-to-participant ratio. 

In addition, working in the after-school pro- 
grams provided them with opportunities for 
leadership development. 

Required Support Services 

Program costs also were influenced by community 
context, such as whether youth could walk home or 
required busing. Some of the programs incurred 
costs for transporting almost all youth home on a 
daily basis, while others that served a local neighbor- 
hood had none of these costs at all. Most school dis- 
tricts covered all or part of the cost of daily busing (a 
redirected contribution); the programs paid for 
transportation for field trips from their cash budget. 

Across the programs, there was a range of costs for 
other required services, including snacks and custo- 
dial help. Costs of participants’ snacks varied, 
depending on whether the after-school programs 
obtained them through the schools’ free and 
reduced-price lunch program. The actual cost was 
higher per snack when the food came as a redirected 
contribution through this program, but the sites did 
not have to rely on scarce cash resources to cover the 
costs. There was also a range of costs for custodial 
help. One school, for example, promoted one of its 
custodians (at a cost of approximately $7,500 annu- 
ally) so he could be assigned to a later, one-person 
shift to cover the after-school program’s needs. In 
another school, custodians already worked the late 
shift, so no cost was incurred when the school re- 
arranged cleaning assignments to accommodate the 
after-school program. 



Accurate Planning 

Finally, the after-school programs’ ability to plan 
effectively for the actual number of youth who partici- 
pated each day had an effect on costs. Programs cost 
more if resources were under-utilized. Sites that 
planned activities, hired teachers and arranged trans- 
portation, not for the number of registered youth, 
but for the number of youth expected to attend, 
avoided paying for resources that ended up not being 
used. As they became more familiar with participation 
patterns, some of die programs solved the problem of 
under-utilization of resources by allowing over-enroll- 
ment for activities — diey knew that only a percentage 
of die youth would attend. Other programs began to 
keep waiting lists and replaced dropouts from an 
activity with newly registered youth. 

How Were the Programs Funded? 

The ESS after-school programs received most of their 
resources from foundations, school districts, govern- 
ment agencies and CBOs. Figure 4 shows, on aver- 
age, how the 10 intensive study programs were 
funded for the 1999-2000 school year. Almost half' 
the funding, 45 percent, came from foundation 
grants, and more than 86 percent of that foundation 
money was from die Wallace-Reader’s Digest Funds. 38 
Foundation funding was usually given in the form of 
cash grants and was primarily used to pay salaries. 

School districts (and schools) contributed 21 percent 
of the funds, government agencies at federal, state 
and local levels gave 17 percent and CBOs provided 
10 percent. While most of the support from CBOs 
came from program’s sponsoring organizations, sev- 
eral sites obtained significant additional resources 
from local, non-sponsoring CBOs. By design, youth 
attended the program at no cost to their families, so 
sites received no income from participant fees. 39 

The sidebar provides an overview of both the rev- 
enue and expenses of the average after-school pro- 
gram discussed in this chapter. 
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What Strategies Are Sites Using to 
Sustain Their Programs ? 40 

The ESS sites have, in general, developed strong rela- 
tionships with school districts, and many of them 
have expanded their funding base to include govern- 
ment funds such as 21st Century Community 
Learning Center grants and state funding. However, 
they still face the task of sustaining their programs 
beyond their grants from the Wallace-Readers’ Digest 
Funds, which were intended to get the sites up and 
running but not to sustain them over the long-run. 

Recognizing that replacing those initial funds was 
going to be challenging, sites began their efforts to 
do so as early as their second year of operations. 

As with most programs, their primary strategy 
focused on writing proposals for available state, foun- 
dation and federal funds. However, while they have 
generally been successful in this strategy, they also 
hope to lessen their dependence on grants, which 
are time-limited and often provide only relatively 
small amounts of funds. They, thus, have broadened 
their fundraising strategies in several ways. 



Average Revenue and Expenses of 
an After-School Program 
School Year 1999-2000 

Funds 


Revenue 




Cash Grants 




Foundations 


$66,073 


CBOs 


5,286 


School districts 


10,440 


Government (all levels) 


5,458 


Businesses 


1.803 


Subtotal: cash revenue 


$89,059 


Redirected Contributions 




CBOs 


$ 9.207 


School districts 


21,268 


Colleges 


9,470 


Government (all levels) 


20,427 


Businesses 


190 


Subtotal: redirected contributions 


$60,567 


Total Revenue 


$149,620 


Expenses 




Program Administration 




Salaries 


$69,694 


Office expenses 


3,427 


0 ut reac h/t rai n i n g/con ferences/t ravel 


6,462 


Subtotal: program administration 


$79,584 


Youth Services 




Youth activities (salaries, supplies, etc.) 


$52,666 


Custodians 


3.455 


Transportation 


9.267 


Snacks 


4,649 


Subtotal: youth sen/ices 


$70,036 


Total Expenditures 


$149,620 


Fund balance, end of school year 


$0 


Source: Cost data for 10 ESS after-school 




programs in the 1999-2000 school year . 
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Expanding to Additional Schools 

On the face of it, expanding a program would seem 
to be a paradoxical way to raise funds; but in three of 
the cities where the intensive research sites are 
located, planners considered starting after-school 
programs in additional schools as away of strength- 
ening their fundraising potential. ESS leaders saw 
this move as politically smart — as a way to increase 
visibility and attract funders who were interested in 
having broader coverage across a city. In addition, 
they perceived this approach as a way to coordinate 
efforts among after-school providers instead of hav- 
ing competition among them. To date, however, 
their efforts are in the early stages and only one of 
the cities has received funding for expansion. 

Raising Renewable Public Funds 

One approach for sustaining after-school programs is 
to raise dedicated, renewable public funds from a 
state, county or city. One site has successfully 
accessed federal Child Care and Development Funds 
for low-income children whose parents use the pro- 
gram as child care and who meet the income eligibil- 
ity requirements. In two other ESS cities, initiative 
leaders have taken part in broad collaborative efforts 
to get legislation written to provide more funds in 
state budgets for youth development and after-school 
programs. However, while efforts to pass legislation 
to support after-school programs may provide signifi- 
cant resources in the future, the cities have not yet 
met with success. Going to the state legislature to get 
public funds is a long-term strategy, and one that 
involves a considerable investment of time and 
resources. 

Building on Local Partnerships 

The design of ESS called for CBOs to play a leading 
role, and it was hoped that this role would include 
involvement in developing a funding base that could 
sustain the programs over time. To this end, the sites 
are drawing on their partnerships in a number of dif- 
ferent ways. Four of the 10 intensive research sites 
(located in two cities) are built on the Bridges to 
Success model, in which local United Ways are key 
partners. In those cases, the United Ways have pro- 
vided funds for the initiative, and this relationship 
holds potential for continuing in the long term. 
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Other sites have, for the most part, also developed 
strong partnerships that could contribute to long- 
term sustainability. In one case, for example, a part- 
nering organization (the Boys Sc Girls Clubs) joined 
with ESS because it was an opportunity to expand its 
programming into schools, thus helping the organi- 
zation fulfill its mission of serving youth in a variety 
of settings; and this partner has expressed its willing- 
ness to shoulder additional costs, if necessary, to 
keep its current ESS program operating. 

In two other ESS cities where the intensive research 
sites are located, the school district has been a partic- 
ularly strong partner and led the way for sites to 
access to federal and state funds. Another site, 
located in a small city, has benefited from a pre-exist- 
ing and very successful collaborative of local non- 
profit organizations, state and county social service 
agencies, the health department, the school district 
and the mayor’s office. Formed in the early 1990s 
with the common goal of providing services to the 
city’s youth, the collaborative had a history of plan- 
ning initiatives and raising funds that made it an 
ideal partnering group for ESS planners. The collab- 
orative was instrumental in helping to initially get 
ESS funded in the city, and it has been an ongoing 
source of support. It is through this collaborative that 
ESS has access to a grant writer, a county employee 
who identifies potential sources of funds and writes 
many of the proposals. 

What are the implications of these 
Findings for Policy and Practice? 

This chapter has "broken down” the cost compo- 
nents of after-school programs to help policymakers 
and practitioners "build up” new programs based on 
local choices and needs. Our findings suggest these 
key "lessons”: 

• After-school program costs are reasonable but vary 
considerably , depending as much on program 
choices , opportunities and local conditions as on the 
number of children served . In examining the costs 
of 10 ESS sites, we found that an after-school 
program can be run for an average of approxi- 
mately $150,000 per school year, serving 63 
youth each day for five days a week. This trans- 
lates into a unit cost (cost per day per youth 
slot) of about $15. Among the 10 programs, 
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however, the cost ranged from $8 to $36 per 
youth slot per day. The unit cost depended as 
much on die after-school programs’ choices 
and their initiative in leveraging additional redi- 
rected contributions, as on the number of 
youth who actually participated each day. 

• Schools and school districts are essential sources of 
support . They made important cash and redi- 
rected contributions to the programs. In the 10 
ESS sites studied, these partners contributed, 
on average, more than 20 percent of the cost of 
the program, including some or all of the cost 
of transportation, snacks and custodial assis- 
tance. This contribution was in addition to the 
rent-free use of the school building. 

• About 60 percent of the ESS programs’ budget needs 
were funded by cash grants . Raising these funds to 
sustain the programs over time is a challenging 
undertaking. The cash budget is the core of the 
program — it pays the salaried staff that adminis- 
ter the program and leverage the redirected 
contributions. For the ESS sites, a large percent- 
age of their cash budget came through support 
from the Wallace-Reader’s Digest Funds. 
Sustaining the programs over time, after initial 
funding ends, is likely to be an ongoing chal- 
lenge. Strong leadership — whether it comes 
from a CBO, the school district or another part- 
nering organization — will be a key to success. 
Thus far, several strategies have seemed promis- 
ing: starting out the initiative in the Bridges to 
Success model, with its United Way funding; 
having strong lead agencies for whom the ESS 
initiative fits a need; and developing strong 
partnerships with other providers and funders. 
Some sites have collaborated with other youth- 
serving initiatives to work toward the ultimate 
goal of dedicated state funding, but this is a 
long-term strategy. More immediately, they are 
likely to have to heavily rely on local resources 
for youth programs, and the availability of those 
resources varies across cities. 

• While much of the focus on planning and sustaining 
programs tends to be on raising cash funding, the 
non-cash portion of the budget cannot be taken for 
granted . Across the 10 ESS sites, 40 percent of 
the budget, on average, was obtained through 
contributions from partner organizations. 



However, as after-school programs grow to scale, 
this form of support is likely to become more 
tenuous. For example, while school district con- 
tributions to the after-school programs grew 
over the course of the initiative, districts in sev- 
eral of the ESS cities are feeling the pressure of 
providing “free” services without additional 
income. (In fact, two districts experienced 
budget reductions during the cost study 
period.) Providing additional custodial hours 
for a limited number of after-school programs 
can sometimes be achieved with little or no 
added expense to the district. However, as the 
number of after-school programs increases, 
there will be a demand for added custodial 
staff. In addition, while the ESS programs were 
exempt, some school districts charge commu- 
nity programs for the use of the school build- 
ing. And even where districts consider the 
schools a community resource already paid for 
by tax dollars, there may be a point at which 
school dollars can no longer cover the expand- 
ing costs connected with increased use of their 
buildings. At that point, the districts will have to 
charge for services or find new tax revenue. ^ 
Making after-school programs part of the offi- 
cial school district budgets, funded by taxes, has 
not yet happened. 

A similar dilemma exists for CBOs. Currently, 
many CBOs share their resources with fledgling 
after-school programs. These local CBOs gener- 
ally have relatively stable funding and an admin- 
istrative infrastructure that enable them to assist 
new programs with many redirected contribu- 
tions, including administrative expertise in 
management and finances, and staff to lead 
after-school activities. However, CBOs’ resources 
are limited. While the marginal cost of con- 
tributing to one after-school program may be 
small, contributing to many after-school pro- 
grams in a city would require expanded 
resources for CBOs, including the hiring of 
additional staff. 

After-school programs, while rapidly growing, cur- 
rently provide services for only a small percent of 
eligible youth. The experience of the ESS sites sug- 
gests the challenges involved in finding sustainable 
sources of cash funding. As after-school programs 
multiply, the challenges are likely to increase for all 
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providers as more programs compete for limited 
resources. In addition, schools and CBOs may need 
to cut back on their contributions unless they 
receive additional funding. 
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VI!. Coocsysions With the passage of the “No Child Left Behind Act” 

in January 2002, the issue of af ter-school program- 
ming will be on the minds and agendas of more peo- 
ple than ever before. This act converted the 21st 
Century Community Learning Centers from a feder- 
ally to a state administered program. Every state is 
eligible to receive a portion of the billion dollars 
appropriated for the program, giving all the states a 
concrete funding opportunity to address the after- 
school needs of school-aged children. With this 
opportunity will come the need to make many deci- 
sions about the goals, design and content of the 
after-school programming, decisions that will influ- 
ence which children and youth participate, what they 
experience and how they may benefit. 

This report has aimed to put policymakers and pro- 
gram operators on firmer ground as they make these 
decisions by providing concrete information from 
existing school-based, after-school programs. While 
we by no means have all the answers, we hope policy- 
makers and program operators will be able to make 
better-informed decisions so that children and youth 
are better served. 

What have we learned? 

1. School-based, after-school programs can be put in 
place fairly quickly and improve over time. 

In our first report on ESS, we found that it typically 
took from six to nine for programs to find organiza- 
tional partners and staff, assess community needs, 
pool additional community and financial resources, 
identify activity providers, and recruit participants. 42 
The initial planning time was critical and, impor- 
tantly, the ESS programs each received a grant of 
$25,000 to $50,000 as well as technical assistance, to 
help support diis process. Over their first three years 
of operations, almost all of the programs developed 
strong relationships with their host schools, and they 
became better able to identify and address core 
goals. They also began to focus more on addressing 
program quality, rather than just program provision. 

2. Demand for the programs is substantial. 

Polls notoriously overestimate demand. But in the 
case of after-school programs, parents not only say 
they want them for their children, they enroll their 
children in large numbers. Among the 10 programs 
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we intensively studied, eight considered themselves 
to be operating at capacity — serving as many students 
as they could within their available resources — by 
their second year of operations. In fact, interest in 
the after-school programs was so high, relative to 
available resources, that three of those programs 
capped their enrollments, and one program, in its 
effort to meet the demand for registration, limited 
die number of days a week for which each youth 
could register. Across the eight sites that collected 
participation data on all youth who were enrolled in 
ESS (not just those enrollees who were registered for 
this participation study) , slightly more than half of 
the schools’ total populations were attending the 
after-school programs. 

3. Locating the programs in schools serving low- 
income families is a very effective means of target- 
ing services to low-income children and youth. 
However, special efforts are required if programs 
are going to be able to attract older youth and the 
most high-needs students in those schools. 

The students served by ESS reflected the demograph- 
ics of their schools. While, across the sites, partici- 
pants were a diverse group of children and youth, 
they were overwhelmingly low-income, with almost 
three-quarters eligible for free or reduced-price 
lunch. However, while locating programs in schools 
where students have identifiable needs can go a long 
way toward effectively targeting services, it is more dif- 
ficult to attract older youth to the after-school pro- 
grams and to recruit the most high-needs children 
and youth — the students who have the most difficulty 
learning, are most disengaged from school and 
exhibit negative behaviors. In ESS, as has also been 
true in other after-school programs, younger children 
more frequently attended than middle-school stu- 
dents. In addition, despite efforts to develop recruit- 
ment strategies targeted to the most high-needs 
children and youth, the programs found it challeng- 
ing to attract them to the after-school activities. 

4. Choices about program requirements and content 
influence which children and youth enroll in the 
after-school activities and how often they attend. 

Program characteristics affect participation patterns. 
At the ESS sites, planners had to make decisions 
about the goals and design of their programs that 
ultimately had an effect on which children and youth 
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chose to participate and how often they attended. 
These decisions inevitably involved some trade-offs. 
For example, planners who decided that the pro- 
gram should serve, in part, as child care for parents 
were more likely to mandate, or at least allow, five- 
day-a-week enrollment. Planners who decided that 
tutoring would be a daily required activity for each 
participant might, through this decision, have dis- 
couraged youth from attending who felt the most 
frustrated with academics and wanted to avoid any 
additional classroom-like work. 

One key decision was whether to require five-day-a- 
week registration or to allow more flexible schedul- 
ing. Five-day-a-week programs could fully serve 
parents’ child care needs and increase the number 
of days any particular student attended and, thus, 
potentially have a larger effect on developmental and 
academic outcomes. However, programs that 
designed their activities in a more flexible manner 
(for example, art on Mondays, judo on Tuesdays, 
etc.) and permitted registration for fewer days per 
week touched the lives of a larger number of youth 
and may have attracted a wider range of youth. 

Survey responses of ESS participants and their par- 
ents suggest that there are no easy answers for pro- 
grams as they make their decisions. Substantial 
proportions of both the youth and parents said the 
youth did not attend ESS more often because they 
had other tilings to do elsewhere. Some of these 
youth and their parents did not want to commit to 
more intensive participation in a single program. At 
the same time, however, a significant number of par- 
ents said that restrictive enrollment policies — where 
their children were allowed to register for only a few 
days a week — limited the amount of time they might 
otherwise have participated in ESS. 

5. The costs are reasonable. 

The 10 geographically dispersed, after-school pro- 
grams of different types we studied had an average 
unit cost of $15 per youth slot per day when all activi- 
ties were in session. The typical program ran from 
September to June for five days a week during two or 
three hours after the school day ended, and served 
63 youth per day. Excluding the cost of using the 
school space, programs ran for an average of approx- 
imately $150,000 for the year, with about 60 percent 
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of the cost being covered by cash grants and the 
other 40 percent through redirected contributions. 

6. Cost varies considerably, depending as much on 
program choices, opportunities and local condi- 
tions as on the number of children served. 

While the average unit cost of the 10 programs was 
$15 per youth per day, this unit cost ranged from $8 
to $36 across the 10 programs. The cost of individual 
after-school programs depended on a number of fac- 
tors: decisions about administrative structure, the 
types of activities provided and the staff-to-youth 
ratio; basic requirements of the community setting 
(for example, the need for transportation); and the 
extent of investment in such factors as fundraising 
and the future sustainability of the program. Looking 
across programs at a high or low level of expendi- 
tures in each of these areas, one should ask, “What 
does the program gain by higher expenditures?” 
and “What does the program do without by holding 
expenditures at the low end of the range?” 

7. The current funding system provides few long- 
term and stable financial resources for after- 
school programs. 

While policymakers acknowledge the need to subsi- 
dize after-school programs in poor communities (as 
evidenced by the 21st CCLC funds, some state and 
local funds, and much philanthropic support), the 
current system still requires programs to live year to 
year, scrambling for funds. The most frequent 
responses to this situation among the ESS sites were 
to under- staff the programs and divert staff time to 
fundraising. While under-staffing was the most com- 
mon response, it was also the least effective way to 
meet budget constraints. Staff quality is the key to 
delivering high-quality programming. When there 
were not enough staff to do the job, work went 
undone — including program development, staff 
training and supervision. Additional funding to sup- 
port more complete staffing is critical, but programs 
often found it difficult to undertake sustained 
fundraising efforts because that is full-time work, and 
they were already dealing with staff shortages. Sites 
that were able to explicitly focus resources on 
fundraising were more successful in expanding their 
funding base and securing their sustainability for sev- 
eral years. Those programs, however, cost more in 



the short term because of the expenses incurred in 
undertaking this kind of development work. 

The experience of the ESS sites suggests the chal- 
lenges involved in finding sustainable sources of ade- 
quate funding. As after-school programs multiply, the 
challenges are likely to increase for all providers as 
more programs compete for limited resources. In 
addition, programs may find it more difficult to gen- 
erate non-cash support as schools and CBOs will be 
asked to provide growing amounts of redirected con- 
tributions — something they may not be able to do 
unless they receive additional funding. 

8. After-school activities have the potential to pro- 
vide a wide range of developmental supports and 
opportunities to children and youth. It is how staff 
deliver the activities, not the topic or skill being 
addressed, that determines the strength of those 
developmental opportunities. 

Activities of all types — be they academic, enrichment, 
community service or sports — can provide children 
and youth with valuable developmental supports and 
opportunities. By participating in a range of challeng- 
ing and interesting activities, young people have the 
chance to develop new skills and interests, build posi- 
tive and supportive relationships with adults and 
peers, and develop a sense of mattering through mak- 
ing decisions and taking on leadership roles. 

Staff practices and behaviors are the critical ingredi- 
ent. Staff in high-quality activities set up physically and 
emotionally safe environments in which they heighten 
and sustain youth’s interest, make the activity chal- 
lenging, and promote learning and self-discovery. 
Academic activities like homework help are a “given” 
in school-based, after-school programs and, when 
done well, provide youth with strong adult support 
that has value beyond the immediate purpose of build- 
ing academic skills. At the same time, however, other 
types of activities seem to more readily lend them- 
selves to providing richer developmental opportunities 
to youth. These include well-implemented enrichment 
activities and open-ended, youth-driven projects in 
which participants work together in teams. Thus, pro- 
grams should consider offering a range of activities for 
their after-school participants, rather than focusing 
narrowly on academics. 
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9. Participation in the after-school programs was 
associated with improved school attitudes and 
behaviors and with a greater likelihood of staying 
out of trouble. 

Two often-expressed goals of school-based, after- 
school programs are to reduce youth’s risk-taking 
behavior and to improve their academic outcomes. 
When we examined outcomes related to risky behav- 
ior, we found that those who attend ESS programs 
reported less often that they had started drinking 
alcohol and indicated more often that they handled 
their anger in socially appropriate ways. However, we 
cannot definitively say that the programs caused 
these changes. 

Because most of the ESS programs were new and stu- 
dents participated, on average, fewer than two days a 
week, we did not expect to find changes in grades 
and, thus, instead examined indicators of academic 
improvement, such as youth’s sense of competence 
in school and their level of effort. We found that 
youth who attended ESS reported less often that they 
had started skipping school and reported more often 
that they really paid attention in class and were very 
proud to belong to their school. Again, while these 
changes were associated with participation in ESS, we 
do not know whether the programs caused them. 

Some of the apparent benefits may reflect the fact 
that better-behaved and more academically inclined 
children and youth participate in school-based, after- 
school programs. However, participants and their 
parents both echoed the benefits. Approximately 70 
percent of the participants cited making friends, see- 
ing new life choices, feeling better about themselves 
and learning that hard work pays off as important 
benefits of attending the after-school programs. 
Parents even felt more positively about the benefits 
of their children’ participation. Among the parents, 
80 to 90 percent said that ESS was helping their child 
make new friends and get along better with their 
peers, stay out of trouble, like school more and try 
harder in school, learn new skills and become more 
self-confident. 

In addition, parents felt that they also benefited. 
AJmost half said that having their children in the ESS 
program helped them attend classes or job training 
more easily, or helped them get a better job or do 
better at their job. In addition, 80 percent of parents 



Multiple Choices After School: Findings from the Extended-Service Schools Initiative 



said they were less worried about their children’s 
safety after school because of ESS. 

However, after-school programs are not a panacea. 
Especially when considering older youth, who appear 
less likely to attend school-based, after-school pro- 
grams, policymakers may need to shift their thinking 
from creating th£ program to expanding the set of 
options available in a community. 

As children become older, they begin to search for a 
wider range of experiences. This expansion in their 
worlds is developmental ly appropriate, but it means 
that the participation rates of older youth in any par- 
ticular program — be it ESS or something else — will 
likely be relatively low. They are most likely to benefit 
if they, and their parents, are able to put together a 
mosaic of positive experiences — broadening the 
range of activities, widening their geographic hori- 
zons, and increasing their network of adults and 
peers. If there are several opportunities in their com- 
munity that attract them, they can still be well served 
even though no one program seems to be engaging 
them intensively. As a recently released National 
Academy of Science report emphasizes, “The diversity 
of young people, their particular needs and their sur- 
rounding environments argue against the notion that 
a single [type of] program will fit all situations.” 43 

Programs that promote development — academic, 
physical, emotional and social — happen now in many 
places, including schools, youth centers, churches 
and libraries. And many of the children and youth 
who participated in ESS attended other organized 
activities as well. In general, however, children and 
youth in low-income communities have limited access 
to high-quality, developmen tally challenging activities, 
particularly in comparison to what is available in 
more affluent neighborhoods. In addition to having 
fewer resources, the young people in these communi- 
ties are vulnerable to more problems associated with 
poverty and more risk factors, such as crime, drug use 
and diminishing opportunities for work. 

Given the increasing challenges to children’s lives 
and the increasingly more complex sets of skills and 
abilities that are required for success in the work- 
place of the twenty-first century, we may need to 
revisit how and where we make investments in our 
nation’s children. This report has examined one type 
of investment — school-based, after-school programs 
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run by CBOs in collaboration with schools. We found 
these programs, which are not strictly academic, 
appear to help participants work on many of the 
competencies they need for their future. When well 
planned and implemented, such programs can be a 
substantial option within a potentially larger network 
of diverse programming that provides a range of 
opportunities for all children and youth. 
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Programming in Place. Philadelphia: Public/Private Ventures, 2000; 
and Jean Baldwin Grossman, Karen E. Walker, and Rebecca Raley. 
Challenges and Opportunities in After-School Programs: Lessons for 
Policymakers and Funders. Philadelphia: Public/Private Ventures. 
2001 . Both are available at www.ppv.org. 

7. The chapter draws from information covered in the evaluation’s 
two previous reports, as well interviews and organizational survey 
data from Spring 2001, the programs’ third year of operations. 

8. The founding organizations that provided technical assistance for 
each model were the Fund for the City of New York s Youth 
Development Institute (Beacon programs); United Way of 
America and the Institute for Educational Leadership (Bridges to 
Success programs); the Children’s Aid Society in New York City 
and Fordham University's National Center for Communities and 
Schools (Community Schools programs); and the University of 
Pennsylvania’s Center for Community Partnerships (WEPIC pro- 
grams). In addition, technical assistance from the Finance Project 
helped ESS programs connect to a broader network of after-school 
resources and identify* a wide array of potential funding sources. 
Finance Project staff also visited each program to help them 
develop and implement a plan for long-term sustainability. 

9. The data are from 52 programs that responded to a survey in 
Spring 2001. 



10. See Grossman et al., Challenges and Opportunities in After-School 
Programs, for a discussion of the transportation issues the pro- 
grams faced during their early implementation period. 

11. During summer, other vacation, in-school and during-school pro- 
grams, activity emphasis is naturally somewhat different than in 
programming during the after-school hours. During summer ses- 
sions, for example, there is relatively less time spent on academic 
activities (although they are still an important offering) and rela- 
tively more time devoted to cultural enrichment and sports and 
recreation. Activities offered during the regular school day focus 
almost exclusively on academic help and sports and recreation. 

12. A few of the ESS sites also provide additional services. Eleven pro- 
grams offer health services to students, and in some cases, these 
services also extend to parents. Two programs offer legal aid serv- 
ices. In conceptualizing extended-service schools, funders and pol- 
icymakers sometimes envision these supplemental services as 
being part of what school centers can offer. Because schools are 
widely recognized public facilities in the hearts of communities, 
they appear to be ideal places for services like social work referral 
and health clinics. However, these types of services require careful 
planning and constitute an added expense. Not surprisingly, then, 
only a few of the ESS programs have attained the capacity to 
include them. 

13. For a full discussion of the planning process and who was 
involved, see Walker et al., Extended-Sewice Schools: Putting 
Pmgramming in Place. 

14. See Walker et al., Extended-Service Schools: Putting Programming in 
Place , and Grossman et al., Challenges and Opportunities in After- 
School Programs. 

15. Discussions of participation include Building Quality and Supporting 
Expansion of After-School Projects: Evaluation Results from the TASC 
AJler-School Program’s Second Year. Policy Studies Associates, Inc., 
2001; and Evaluation of the MOST (Making the Most of Out-of-School 
Time) Initiative: Final Report. Robert Halpern, Julie Spielberger and 
Sylvan Robb. Chapin Hall Center for Children. 2000. 

16. These youth are a subset of the total number of youth enrolled in 
the ten programs. For youth to become part of the research study, 
their parents had to sign a permission slip and complete a form 
providing demographic information and the reasons why they 
chose to register their children in ESS. Parents of approximately 
50 percent of the youth enrolled in ESS registered their children 
in the study. 

17. One recent study that examines youth’s ongoing participation in 
after-school programs suggests that effects take several semesters 
to materialize. See Denise Huang et al. A Deccule of Results: The 
Impact of the LA's BEST After-School Emichment Program On Subsequent 
Student Achievement and Perfoimance. Los Angeles: UCLA Center for 
the Study of Evaluation, Graduate School of Education and 
Information Studies.June 2000. 

18. In its evaluation of programs operated by The After School 
Corporation (TASC), Policy Studies Associates, Inc. similarly 
found that the proportion of students attending at least three days 
a week was greater for programs serving elementary schools 
(81%) than for those serving middle schools (40%) or combined 
elementary-middle schools (74%). See Building Quality and 
Supporting Expansion of After-School Projects. 
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19. In reporting why they enrolled their child in ESS, 83 percent of all 
parents surveyed said it was because the child wanted to get 
involved; 53 percent saw the program as offering their child 
opportunities for academic improvement; and 48 percent saw the 
program as a safe place for their child to be after school. 

20. Another study points to some of the issues faced by planners as 
they decide whether their programs should have mandatory five- 
day-a-week or flexible enrollment policies. A study of the San 
Francisco Beacons Initiative in its formative years found that par- 
ticipation during a typical month varied, in part, by the degree to 
which attendance was mandatory. At three centers that included 
programs with mandatory attendance, one-fourth to one-third of 
the youth came 13 or more times during a typical month, or 
almost every day the program was open. At the oflier centers, 
attendance was lower. For example, at one of the centers with low 
attendance, roughly 79 percent of the youth came six or fewer 
times in the typical month — on average, once a week or less. See 
Karen E. Walker and Amy j.A. Arbreton. Working Together to Build 
Beacon Centers in San Francisco: Evaluation Findings from 1998-2000. 
Philadelphia: Public/Private Ventures, 2001. 

21. Each of the 30 activities was observed two or three times. Each 
time, the researcher observed the entire activity and used an 
observation instrument that required her to rate such features as 
the quality of adult-youth relationships, peer relationships, deci- 
sion-making and leadership opportunities for youth, and youth 
engagement Ratings were averaged over the two or three observa- 
tions to come up with a mean score for each characteristic. 
Characteristics were rated on a 5-point scale, with 5 being the 
highest. Ratings of 2 or less meant not just the absence of a posi- 
tive dimension but the presence of something negative. 

22. See, for example, Michelle Alberti Gambone. Launching a Resident- 
Driven Initiative,: Com munity Change for Youth Development (CCYD) 
from Site-Selection to Early Implementation. Philadelphia: 
Public/Private Ventures, 1997; and Michelle Alberti Gambone and 
.Amy J.A. Arbreton. Safe Havens: ' The Contributions of Youth 
Organizations to Healthy Adolescent Development. Philadelphia: 

Public/ Private Ventures, 1997. 

23. In both of these poorly implemented activities, staff did not lead 
effectively. In one, a recreational dance activity, staff were present 
in the room, but did not instruct youth and barely interacted with 
them. While this did not interfere with the girls’ enjoyment of the 
activity (they taught each other dance steps and appeared to be 
having fun), the adults did not take advantage of opportunities to 
provide youth with developmental supports and opportunities. 

The second activity was chaotic both times it was observed. 
Misbehaving youth completely disrupted the activity because staff 
were not effective in controlling the youth’s behavior. 

24. L.S. Vygotsky. Mind in Society. Cambridge. Mass.: Harvard 
University Press, 1978. 

25. W. Larson. “Toward A Psychology Of Positive Youth Development.” 
American Psychologist, 55, 170-183, 2000. 

26. See Joseph P. Tierney, Jean Baldwin Grossman, and Nancy L. 

Resch. Making .4 Difference: An Impact Study of Big Brothers Big Sisters. 
Philadelphia: Public/Private Ventures, 1995; andJ.E. Rhodes, J.B. 
Grossman, and N.L. Resch. “Agents of Change: Pathways Through 
Which Mentoring Relationships Influence Adolescents’ Academic 
Adjustment." Child Development, 71, 1662-1671, 2000. 



27. The numbers in Table 6, and later in Table 8, represent estimated 
outcomes for two groups of youth who are identical in their 
observable characteristics but differ in the amount of time they 
have participated in ESS. The predicted outcome levels are based 
on statistical analysis of the youth 's characteristics, their experi- 
ences and their outcomes as reported in the baseline and follow- 
up surveys. We discuss only outcomes that differ statistically by ESS 
participation at a 90 percent level of confidence. See Appendix B 
for more details about the methodology. 

28. See Huang, A Decade of Results. In addition, a study of older youth 
has found that participation in all forms of high school extracur- 
ricular activities (including sports, academic clubs, performing 
arts and school involvement activities) were associated with higher 
grade point averages in twelfth grade. See Jacquelynne Eccles and 
Bonnie Barber. “Student Council, Volunteering, Basketball, or 
Marching Band: What Kind of Extracurricular Involvement 
Matters ? m Journal of Adolescent Research, Vol. 14, No. 1, 10-43, 
January 1999. 

29. See Tierney et al., 1995; and Rhodes et al., 2000. 

30. See Reisner, Elizabeth R. et al. Building Qiiality and Supporting 
Expansion of After-School Projects. Washington, D.C.: Policy Studies 
Associates, Inc., 2001; and Warren, Constancia. Evaluation of the 
New York City Beacons: Phase 1 Findings. New York: Academy for 
Educational Development, 1999. 

31. The 10 schools include three elementary schools, four middle 
schools, and three mixed elementary and middle-school pro- 
grams. The cost figures for each program cover the 1999-2000 
school year. Costs are for after-school programs only so that all 10 
programs can be compared on the same basis. Thus, while some 
of the ESS sites provided school-day activities, evening programs 
for older teens or parents, separate weekend programs and sum- 
mer programs, these costs are excluded. In general, most costs 
cover 10 months — for example, when salary costs are considered, 
only 10 months of a site coordinator’s salary is included. In addi- 
tion, the cost of using school buildings or other facilities is 
excluded. See Appendix C for more details about the methodol- 
ogy- 

32. The most obvious example of the different factors driving costs for 
non-school-based, after-school programs is the probable lack of 
access to free use of school space for programming. Thus, rent 
might become a significant cost. But there are other, smaller fac- 
tors as well, including, for example, providing snacks through a 
federally funded nutrition program that schools, but not CBOs, 
can access. 

33. Sometimes, after-school programs did not run a full schedule of 
you til activities until the second or third week of the program’s 
semester. Likewise, some activities were of shorter duration and 
ended before the after-school program semester ended. A “fully- 
operational program” refers to those weeks when all activities were 
in session. 

The youth slot cost is calculated for those weeks. A “slot” may be 
filled by the same youth each day or by different youth on differ- 
ent days. For example, one youth attends on Monday and 
Wednesday and another youth participates on Tuesday and 
Thursday; together, the two youth occupy one youth slot 

34. The unit cost is estimated, as follows: the cost of the program per 
week is calculated by dividing the average total program cost 
($149,620) by the average number of weeks of programming (33 
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weeks). The average cost per week across all 10 programs was 
$4,534. The average weekly cost is then divided by the average 
number of days per week that programs offer youth activities (4.7 
days). The average daily program cost is then divided by 63, the 
average number of youth who attend the program each day (one 
proxy for this number is the number of snacks that a site serves 
each day), resulting in the cost per day per youth slot of $15. 

35. This study does not include the value of volunteer time in the 
redirected contributions. 

36. Two recent studies have also examined die cost per day per youth 
slot in after-school programs. A cost analysis of Los Angeles’ LA’s 
BEST after-school programs, which were also operated in school 
facilities, found an estimated cash cost of under $5 per day for one 
youth slot. Even with the addition of redirected contributions, die 
LA s BEST unit cost is far below the ESS unit cost. There are sev- 
eral possible explanations. The most plausible one is that the pro- 
grams benefited from economies of scale — the LA’s BEST system 
operates more than 80 after-school programs and enrolls approxi- 
mately 15,000 youth during the after-school hours. This study was 
reported at www.lasbest.org. 

The study of die MOST (Making the Most of Out-of-School Time) 
initiative estimated an average weekly cost of about $80 per child 
per week for a five-dav-a-week program, which is slightly more 
than the ESS unit cost of $1 5 per youth slot per day. Although the 
study relied exclusively on program-supplied budgets, which were 
not entirely comparable, many of the budgets counted expenses 
covered by redirected contributions. Unlike the ESS cost study, 
some of these budgets included rent for the use of facilities. See 
Halpern et al., Evaluation of the MOST (Making the Most of Out-of- 
School Time.) Initiative. 

37. In addition to these other factors, the four programs that oper- 
ated under the Beacon’s model tended to have higher administra- 
tive costs because they had an extra layer of administrative 
structure. While the other models have two administrative layers 
(the lead agency and ESS program staff), there are three layers in 
the Beacon’s model. A local intermediary provides technical assis- 
tance and acts as the fiscal agent for all Beacons in a city. Then, 
there is an individual lead agency for each Beacon program. The 
third layer is Beacon program staff. 

38. The Wallace-Reader’s Digest Funds gave a substantial cash grant to 
each ESS site in the initiative with the condition that school dis- 
tricts provide space and that sponsoring organizations obtain 
some matching support. 

39. One of the sites, in Boston, did charge families a fee for their 
children’s participation because this was required by one of their 
funders. 

40. Information in this section is based on interviews with key part- 
ners in the cities where the 10 intensive research programs are 
located and on responses to a survey sent to all of the ESS com- 
munities in Spring 2001. 

41. Using tax revenues to help support after-school programs is not an 
entirely new idea. For example, in Minneapolis, the school district 
was able to contribute state-funded Area Learning Center dollars 
to pay teachers of youth activities in the ESS programs. 

42. See Walker et al., Extended-Service Schools: Putting Programming in 
Place. 



43. Eccles, Jacquelynne and Jennifer A. Gootman. Washington, D.C.: 
National Academy Press, 2001 . 
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Appendix A 

The Extended-Service School Models 

The Extended-Service Schools (ESS) Initiative was 
launched in 1997 by the Wallac e-Read er’s Digest Funds to 
create 60 extended-service schools in 20 cities across the 
country. Each city adapted one of four nationally recog- 
nized models that had been successfully developed and 
implemented in other communities in the U.S. The mod- 
els are: 

1. The Beacon, a collaboration of a school and commu- 
nity-based organizations (CBOs). 

2. Bridges to Success, a collaboration of a school, sev- 
eral CBOs and a local United Way. 

3. Community Schools, a collaboration of a school, a 
CBO and a university. 

4. West Philadelphia Improvement Corporation 
(WEPIC), a collaboration of a school and a university. 

The Beacon 

Originally implemented in New York City Public Schools, 
primarily in middle schools. 

Mission: To develop and operate school-based community 
centers; to create “safe havens” for youth and families in 
poor neighborhoods; to promote youth development and 
resiliency. 

Activities: A diverse array of youth development activities in 
five core areas: education, recreation and enrichment, 
career development, leadership development, and health. 
Activities take place during non-school hours and empha- 
size several factors important to youth resiliency: caring 
adult relationships, engaging activities, high expectations, 
youth’s opportunity to make a contribution, and continuity. 

Governance: Each Beacon Center has a lead agency that 
manages all activities at the school. A local organization 
provides technical assistance in organizational develop- 
ment as well as youth development practices. An oversight 
committee, consisting of school district staff and executive 
staff from key CBOs, provides general policy and manage- 
ment oversight. Each school has a school-level decision- 
making body that includes parents and other community 
representation. 



Bridges to Success 

Originally implemented in Indianapolis, Indiana. 

Mission: To increase the educational success of students by 
better meeting the non-educational needs of children and 
their families through a partnership of education, human 
service and community service delivery systems, with a 
long-range vision of establishing schools as “lifelong learn- 
ing centers” and focal points of their communities. 

Activities: Vary according to site, but each site has an over- 
arching goal of promoting positive youth development 
during non-school hours. Activities include educational 
enrichment, career development, arts and culture, life- 
skills, counseling, case management, health and mental 
health services, and recreation. 

Governance: The Local United Way agency acts as the lead 
organization and fiscal agent. A local governance structure 
made up of United Way, school district, social service and 
community representatives develops citywide program- 
ming strategies and oversees implementation. School-level 
councils assess the needs and assets of the community, and 
design and implement program interventions. The coun- 
cils include a program coordinator, school principal and 
other school staff, parents, students and local partners. 

Community Schools 

Originally implemented in elementary and middle schools 
in the Washington Heights section of New York City by the 
Children’s Aid Society. 

Mission: “Educational excellence, combined with needed 
human services, delivered through school, parent and 
community' partnerships.” “Seamless integration of school- 
day activities with extended-day programs.” 

Activities: A wide range of youth development programs 
during the school day and in non-school hours. Social 
services, such as on-site clinics, legal assistance and case 
management, are also provided. Parent education is an 
important component of the Community Schools. 

Governance: Co-management of school facilities by the 
school and a CBO. Management staff from the CBO have 
space in the school administrative office so they can fre- 
quendy interact with school principals. 

Additional characteristics of the ESS national adaptation: 

Local universities play a key role in technical assistance 
and planning. An oversight committee, consisting of uni- 
versity staff, executive staff from key CBOs, and school dis- 
trict staff, proride general policy and management 



67 



58 



Multiple Choices After School: Findings from the Extended-Service Schools Initiative 



oversight. In addition, each school should have a school- 
level decision-making body that includes parents and other 
community representation. 



West Philadelphia Improvement Corporation 
(WEPtC) 

Originally implemented in Philadelphia. 

Mission: A school-based school and community revitaliza- 
tion program to produce comprehensive, university- 
assisted community schools that serve, educate and 
activate all members of the community, revitalizing the 
curriculum through a community-oriented, real-world, 
problem-solving approach. 

Activities: Academically based community service, such as 
graduate and undergraduate interns working in schools to 
provide educational assistance and mentoring to youth. 

Governance: School principals and staff play key decision- 
making roles, such as deciding what substantive areas will 
be addressed through the initiative. Community councils 
provide guidance on program content. 
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Appendix B 

Research Overview and Outcome 
Measures 

This appendix first provides an overview of the evalua- 
tion and data collection for the ESS study, then describes 
in detail the outcome measures used and how we exam- 
ined the relationship between change in outcomes and 
participation. 

Evaluation Overview 

In May 1998, Public/ Private Ventures (P/PV) and the 
Manpower Demonstration Research Corporation (MDRC) 
began the evaluation of the Extended-Service Schools 
(ESS) Initiative, with the aim of providing practitioners, 
funders and policymakers with a rich set of lessons about 
how local school-based collaborations unfold and what 
they do. Our goals were to understand what it took to 
operate these ambitious programs; what practices con- 
tributed to high-quality, sustainable programming; who 
participated and how often; and what effects die program 
had on those participants. 



The evaluation encompassed a multi-method approach 
designed to provide us with both an understanding of the 
breadth of programming experiences and the ability to 
more deeply delve into particular issues. To learn about 
the activities of the ESS programs in all 17 cities involved 
in the initiative, we asked the school coordinators and city- 
level program directors to complete annual organizational 
surveys summarizing what their programs were doing. To 
gain deeper insight into why sites were doing what they 
were doing and to learn more about promising practices, 
we conducted muldple in-depth site visits to 10 cities 
whose programs were operating fairly well by Fall 1998. 
During these visits, we interviewed staff, partners, students, 
parents and key city officials. 

In 10 schools (located in six of those cities), we also col- 
lected computerized attendance records on program par- 
ticipants, gathered cost data, and administered baseline 
questionnaires and follow-up surveys to fourth- to eighth- 
grade students who were enrolled in the ESS study. 1 To 
learn about the program from the parents’ perspective, we 
also conducted telephone surveys of ESS parents in these 



Table B.1: Research Activities by City 





Organizational 

Survey 


Implementation 
Site Visits 


Participation 
and Cost Data, 
Youth and 
Parent Surveys 


Activity 
Observations 
and In-Depth 
Interviews 


Central Falls 


X 


X 


X 


X 


Minneapolis 


X 


X 


X 


X 


Missoula 


X 


X 


X 


X 


Aurora 


X 


X 


X 




Boston 


X 


X 


X 




Savannah 


X 


X 


X 




Atlanta 


X 


X 






Denver Beacons 


X 


X 






Jacksonville 


X 


X 






Long Beach 


X 


X 






Albuquerque 


X 








Denver WEPIC 


X 








Flint 


X 








Greensboro 
and Highpoint 


X 








Mesa 


X 








Oakland 


X 








Philadelphia 


X 








Salt Lake City 


X 
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six cities. Last, in three of the middle schools, we collected 
in-depth, qualitative information through multiple observa- 
tions of all the ESS after-school activities and open-ended 
interviews with 34 children and 25 of their parents. (Table 
B.l, summarizes the research conducted in each ESS city.) 

Data 

The 10 research schools enrolled youth in the study for 18 
months — from the beginning of the Fall 1999 ESS session 
through December 2000, which was the end of the Fall 
2000 session. Enrollment in the study required that par- 
ents or guardians sign a permission slip and complete an 
intake form that provided demographic information and 
the reasons why they chose to register their children in 
ESS. During this period, we collected 2,047 intake forms 
for children and youth in grades 1 through 8 whose par- 
ents or guardians consented to allow them to participate 
in the evaluation. (Table B.2, describes the distribution of 
the enrollees by school.) 

Of these enrollees, 1,708 actually attended at least one day 
of ESS. Eighty-eight percent (1,511) attended at least one 
day during the 1999-2000 or 2000-2001 school years, while 
the others attended only during the summer. The partici- 
pation chapter is based on the 1,511 enrollees who 
attended ESS at least once during the school year. 

Baseline and Follow-up Surveys. Information in the bene- 
fits chapter (Chapter V) is drawn from 371 fourth to 
eighth graders who completed both a baseline and a fol- 
low-up survey. Among the 1,708 enrollees who attended at 
least one day of ESS, 1,144 were in fourth to eighth grade. 
Of these youth, 69 percent (786) completed a baseline sur- 



vey after they began attending activities. In Spring 2001, a 
follow-up survey was administered to students who were 
then in fourth to eighth grade and who had ever enrolled 
in ESS and were still in the school (but not necessarily par- 
ticipating in ESS). Because many of the original enrollees 
had left the school, only 674 youth completed the follow- 
up survey. Of this group, 371 had also completed a base- 
line survey. On average, 12.5 months had elapsed between 
their baseline and the follow-up survey. 

Parent Survey. The parent survey was administered to 221 
ESS parents from a pool of 336 who primarily spoke 
English or Spanish, whose child was in fourth grade or 
higher or at least nine years old at the time of the survey, 
and whose child had attended ESS at least one day during 
the 2000-2001 school year. 

Activity Observation. A total of 30 activities were observed 
in three middle schools. All the activities offered during the 
2000-2001 academic year were observed in Calcutt (Central 
Falls), Porter (Missoula) and Webster (Minneapolis). 
Webster is a k-8 school; however, we observed only the activ- 
ities for fifth through eighth graders. 

Each activity was observed two or three times during the 
program cycle (fall and winter-spring semesters). Each 
time, the researcher observed the entire activity. 
Researchers used an observation instrument that required 
them to rate the quality of a set of constructs or dimen- 
sions, and describe the behaviors and practices they 
observed for each dimension. Ratings for the various 
dimensions were then averaged over the two or three 
observations to come up with a mean score for each 
dimension for that activity. 



Table B.2: Distribution of ESS Study Enrollment by School 



School 


Total Number of Enrollments Received 


Total Number Of Baseline Surveys Received 
(For Children In 4th-8th Grades) 


Shuman (6-8) 


178 


106 


Scott-Tompkins (k-8) 


151 


27 


Gardner (k-5) 


176 


32 


Lincoln (k-6) 


234 


54 


Webster (k-8) 


336 


123 


C.S. Porter (6-8) 


267 


241 


Hawthorne (k-5) 


262 


66 


Calcutt (6-8) 


202 


58 


Veterans (k-5) 


93 


33 


North (6-8) 


148 


46 


Total 


2,047 


786 
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Outcome Measures 

After hypothesizing the outcome areas potentially affected 
by participation in an after-school program, we reviewed 
the existing social-psychological and behavioral measures, 
using those that were appropriate for the study population 
and developing our own when the existing measures were 
not adequate. 



The final follow-up questionnaires included 16 outcome 
measures of behaviors and social-psychological constructs 
across three outcome areas — risk and non-risk behaviors, 
school attitudes and behaviors, and adult support. Seven 
outcomes assessed anti-social activities (including one psy- 
chological scale of conflict management.), and five stressed 
pro-social activities. Three social-psychological constructs 
and one behavioral measure assessed academic outcomes. 
(Table B.3 presents the social-psychological and behavioral 



Table B.3: Outcome Measures 



Risk and Non-Risk Behaviors 

To tap antisocial behavior, we primarily retied on questions 
used in previous P/P V research studies, but we also 
adapted questions developed by Thomas Cook for an evalu- 
ation of a middle school reform project.* The single item 
questions assessed anti-social behaviors, including the 
number of times the youth used alcohol, hit someone, took 
something from the school, damaged property, was involved 
in a fight, and was sent to the principal’s office. The pro- 
social items were related to activities that youth might expe- 
rience in a structured after-school program. The specific 
items were: 

Risk Behavior: 

How many times in the past 4 weeks have you: 

a. Hit someone? 

b. Skipped a class? 

c. Damaged school property? 

d. Drunk alcohol? 

e. Taken stuff at school that wasn’t yours? 

f. Been sent to the principal’s office? 

Conflict Management: 

When I have a problem or argument with another student: 

a. I yell at them. 

b. I ignore them. 

c. I talk to an adult about it. 

d. I push or hit the other person so that it doesn’t hap- 
pen again. 

e. I control my anger. 

f. 1 talk things over with them. 

g. When other children try to hit me or push me around, 1 
fight back. 

h. 1 fight or argue with adults. 

Non-Risk Behavior 

How many times in the past four weeks have you: 

a. Written a poem, story or play, or written in a journal or 
diary, not for school? 

b. Read a book from beginning to end that wasn’t 
assigned for school? 

c. Taken art, dance or music classes (not during the 
school day)? 

d. Done volunteer work? 

e. Performed in front of others (such as reading a poem, 
singing, dancing or giving a speech)? 



School Attitudes and Behaviors 

Youth were asked how true each of these statements was 
for them, on a four-point scale ranging from “not true at all” 
to “very true.” 

Belonging: 

a. 1 am proud of belonging to this school. 

Efficacy: 

a. I’m certain 1 can master the skills taught in school this 
year 

b. I can do even the hardest work in my classes if I try. 

c. I can do almost alt the work in school if I don’t give 
up. 

d. Even if my school work is hard, I can learn it. 

e. I’m certain I can figure out how to do even the most 
difficult school work. 

Effort: 

a. I don’t try very hard in school. 

b. I often come to class unprepared. 

c. I work very hard on my school work. 

d. I pay attention in class. 

How many times over the past four weeks, have you not 
had your homework done on time? 

Non-Family Adult Support 

Youth were asked how many adults outside of their parents 
and relatives: 

a. Pay attention to what’s going on in your life? 

b. Say something nice to you when you do something 
good? 

c. You could go to if you need some advice about per- 
sonal problems? 

d. You could go to if you are really upset or mad about 
something? 



* T.D. Cook, H.D. Hunt and R.F. Murphy. “Comer’s School 
Development Program in Chicago: A Theory-Based 
Evaluation.” American Educational Research Journal , 37(2), 
535-597, 2000. 
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Table B.4: Cronbach Alphas for the Baseline (BQ) and Follow-Up (FQ) Variables 



Scale 


Number of 


Cronbach’s 


Standardized 




components 


Alpha 


Alpha 


BQ: School belonging 


5 


0.741 


0.746 


BQ: School efficacy 


5 


0.755 


0.757 


BQ: School effort 


4 


0.531 


0.557 


BQ: School engagement 


5 


0.618 


0.619 


BQ: Hope for future 


5 


0.700 


0.717 


BQ: School liking 


3 


0.780 


0.783 


BQ: Instrumental support by friends 


3 


0.808 


0.808 


BQ: Self-esteem support by friends 


3 


0.851 


0.852 


BQ: Conflict management 


8 


0.741 


0.743 


BQ: Parent involvement in school 


5 


0.720 


0.721 


BQ: Instrumental support by adults 


3 


0.801 


0.799 


BQ: Self-esteem support by adults 


4 


0.848 


0.851 


FQ: School efficacy 


5 


0.814 


0.813 


FQ: School effort 


4 


0.479 


0.494 


FQ: Conflict management (short) 


7 


0.757 


0.758 


FQ: Instrumental support by adults (short) 


2 


0.855 


0.855 


FQ: Self-esteem support by adults (short) 


2 


0.770 


0.770 



measures included on the follow-up questionnaires.) The 
rest of this section discusses the measures used, the pretest 
of the survey instrument, and the reliability of the 
included measures. 

Review and Pretest 

Two psychologists, Jacqueline Eccles, of the University of 
Michigan, and Deborah Lowe Vandell, of the University of 
Wisconsin, reviewed the baseline questionnaire for its suit- 
ability for addressing the study’s research hypotheses. After 
further review by P/PV research staff, the baseline ques- 
tionnaire was pre-tested with children in a Philadelphia 
school-based, after-school program. The follow-up ques- 
tionnaire was pre-tested at both a Philadelphia and a 
Princeton, New Jersey, school-based, after-school program. 

Reliabilities 

The reliability of a scale refers to its stability, i.e., how con- 
sistently the scale measures an underlying construct. We 
re-evaluated the internal consistency reliabilities of each 
scale for our study sample, both at baseline and at follow- 
up, to help assess whether the scales “worked” as measures 
of specific outcomes for the ESS sample. 



Cronbach’s alpha is a statistic used to assess internal con- 
sistency reliability, the degree to which scale items each 
measure a common underlying attribute. 2 Values of alpha 
range from 0 (indicating no internal consistency — that the 
items have literally nothing in common) to 1 (indicating 
perfect consistency among the items — that each item is 
perfectly correlated with the scale as a whole). We con- 
sider values of .60 or above to be acceptable. 

AJpha values were calculated for all scales used as outcome 
measures. Internal consistencies were all acceptable, rang- 
ing from .53 to .85 at the baseline variables, and from .48 
to .86 at the follow-up variables. The only follow-up scale 
with alphas less than .60 (indeed less than .75) was School 
Effort. This scale was eliminated, and the single item, “I 
pay attention in class” was used to gauge school effort. The 
reliability coefficients at both baseline and follow-up are 
listed in Table B.4. 

Analysis of Behavioral and Attitudes Changes 

Our strategy entailed comparing (correlating) the changes 
over time in experiences, attitudes and behaviors of chil- 
dren who participated in the after-school program for 
many hours and those who participated for relatively few 
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